Keynote

Platform improvements

• MacOS 27 is called Golden Gate
• Focusing on bug fixes and small improvements
  • Various things are faster
  • Better iphone network swapping
• Liquid glass
  • More diffusion, for readability. With slider option
  • Mac apps have a toolbar again
  • Sidebars go back to the left edge
  • Apps have the same corner radius
• Re-architected spotlight index
• Shared albums will support android
• Used vision models to improve fly-over in maps

Trust and Safety

• Expanded child safety features
• Adapting AAP family media plan into a guide for apple features
• “Ask to browse” for the web, like the existing flow for apps
• “Ask to contact”
• Adds gore/violence to the image content filter
• Time allowances, new feature of screen time
• Screen time schedules, for example to do school

Apple Intelligence

• Architecture
  • Apple foundation models combined with gemini models from google
  • Can run on servers and on-device
  • Supported devices can generate speech with a second on-device model
  • Uses spotlight to power a new orchestrator, with the personal context
  • Privacy-first
• Siri AI
  • More conversational
  • Dedicated siri app
  • Visual intelligence
    • Even on macOS, via a screen-shot-like tool
  • New voice, with real inflections
    • Can be adjusted on various axis
  • Dictation is more accurate, and built into the keyboard
  • Tailored experience per platform, ie
    • Pull down from dynaic island
    • Side button to speak a question
    • Integrated with spotlight on mac, type a question which is detected as an AI query
    • Activate from a context menu on mac, including a text box
  • Siri app to view previous chats, synced with icloud
  • Email/message drafting follows your usual patters per contact
  • Automatic proofreading
• Apps
  • Safari
    • Automatically organize tabs by topics
    • Notify me: monitor a page for changes
    • Describe an extension, use a prompt to get a custom web extension
    • Can agentically fix bad passwords by changing them
  • Messages / Mail, new calls to action, contextually
  • Calendar, create events with natural language
  • Home
    • Consolidated notifications
    • Summarized camera clips
  • Shortcuts, describe a shortcut via prompt
  • Image playground. Rebuilt app, with more realistic options.
  • Photos
    • Better cleanup, new Extend images
    • Spatial reframing
• All free, with daily usage limits for some features. Limits increase with icloud+ plans.
• CoreAI framework. Run your own models on apple hardware
• Gemini added to xcode models
• Device hub, a new app to combine simulators and use more gestures