Keynote

AppleTV+

• Highest rated original programs
• New season of severance, shrinking, and other new films and shows

VisionOS 2

• Turn normal photos into spatial photos
• SharePlay in photos
• New hand gestures
• Higher “Mac” external display sizes
• Adding train support, like airplane mode
• Canon has a new lens for recording spatial videos

iOS 18

• Home Screen
  • Move apps anywhere, ie blank spaces
  • Dark mode icons, or a tint color
• Control center
  • New control groups by swipe
  • Controls gallery, for adding controls
  • Developers can add controls from their apps. ControlsAPI
    • Also available on Lock Screen, replacing camera and flashlight. Or action button.
• Privacy
  • Lock an app, requires Face ID to open that app.
  • Hide an app
  • Share specific contacts with an app (like photos)
  • Connect to specific devices on local network
• Messages
  • Tapbacks, ie reactions, now are in color, any emoji
  • Scheduled Send
  • Text formatting, bold underline italics, etc
  • Text effects, shake, ripple, etc
  • Messages via satellite (on iPhone 14+)
• Mail
  • On device categorization
  • Digest view, all recent emails from a business
• Maps
  • Topo maps, with trail and hiking routes. All national parks can save offline
• Wallet
  • tap to cash
• Journal
  • Log state of mind
  • Stats and insights
• Game mode
• Photos
  • Single view, grid at top, collections at bottom
  • People groups
  • Trips section
  • Customize what things appear in various sections

Audio and Home

• AirPods
  • Nod or shake to interact with Siri
  • Voice Isolation (AirPods pro)
  • Spatial Audio API, brings it to gaming apps
• tvOS
  • InSight shows actors on screen for apple shows
  • Option to Boost voices in a movie
  • Projector support for 21x9 movie formats

WatchOS 11

• Training load, track workout effort over time, as a build up to a big event
• Customize summary tab in phone activity app
• New app “Vitals”, explore health metrics, and over time
• Pregnancy info added to cycle app
• Translate app now on watch
• Live activities
• Redesigned photos face

iPadOS 18

• Most features from iOS of course
• Floating tab bar, that can morph into the sidebar
• SharePlay screenshare, you can draw on the screen or remote control
• Calculator on ipad
  • History and unit conversions
  • Works with Apple Pencil, Math notes.
    • Supports variables
    • Mirrors your handwriting
    • Graphs
    • Sliders to edit values
    • Works in Notes app as well
• SmartScript, modifies your handwriting to be a bit more legible, but still looks like your own.
  • Text can flow, so you can edit and reflow various paragraphs

macOS Sequoia

• Math notes, messages, maps etc
• Continuity
  • iPhone mirroring, control iPhone from Mac.
    • Phone notifications in the Mac notification centers
    • Phone stays locked
    • Drag and drop
• Window tiling by dragging to the edge of the screen
  • Keyboard shortcuts as well
• Presenter preview for sharing a window
  • Background replacement too
• Keychain: Passwords app
  • Verification codes
  • On all devices, even windows
  • Shared groups
• Safari
  • Highlights, summaries of the current page
  • Reader, with TOC and summary
  • Viewer, Zooms into a video
• Gaming
  • Porting toolkit 2, improves stuff. And ports Mac to iPhone.
  • More advanced games coming. (Riven remake?)

Apple Intelligence

• Powerful, Intuitive, Integrated, Personal, Private
• Capabilities
  • Create language
    • Understand personal context
    • Prioritize notifications
    • Writing tools, proofread, summarize, revise
    • Built into system text view
  • Images
    • Can personalize generated images based on photo library
    • Image styles: sketch, animation, illustration
  • Take actions
    • Kinda like Siri already is, but more action types
• Architecture, privacy at the core
  • On device processing
  • Aware of personal data, without sending it out
  • On device semantic index
  • Private cloud compute
    • Use large server based models on apple silicon
    • Sends only data relevant to your task to the servers
    • Independent verifications, via a public log
• Experiences
  • Siri
    • More natural, relevant, and personal
    • New look, glowing light around screen
    • Maintains context for chained requests
    • Type to siri, double tap at the bottom of screen
    • On screen awareness
    • In-app actions, via expansions to App Intents
  • Writing tools
    • Rewrite, different version of what you already have. Inline suggestions.
    • Proofread. Grammar and spelling
    • System wide, including third party apps
    • Mail smart reply, with suggestions, and form style details
    • Email summaries in the list, instead of message
  • Notifications
    • Summaries, new focus
  • Genmoji
    • Describe a custom emoji
    • Can make it look like someone from photos
  • Image Playground
    • On device, by themes
    • Can also add custom descriptions
    • Messages, Freeform, keynote, new Image playground app, and an API
    • Image Wand
      • Turn a sketch from notes into an image
      • Circle a sketch to enter an image playground based on that context
  • Photos
    • Cleanup tool removes extra background items
      • lol, they removed a bagpiper
    • Search for very specific things
    • Search in videos
    • On demand custom photo montages
• ChatGPT support in Siri
  • Asks permission to share with chatGPT first, for each request
  • Free, or connect your account
  • Intend to support other models in the future
• Developer SDK
  • Image playground API
  • Writing tools automatic
  • SiriKit without additional work
  • New App Intents