WWDC2024 Day 1 content related to AI

Apple Intelligence's five principles:

  • Powerful
  • Intuitive
  • Integrated
  • Personal
  • Privacy protection (private)

【Function Introduction】

Language processing

  1. Notification priority management
  2. Assist in writing, check text, optimize input

  3. Record phone calls and take memos (Memo)

Image processing

  1. Generate images based on avatars
  2. Genmoji - Create custom emojis

  3. Playground - Generate images in various styles based on emojis and keywords

  4. Turn drafts into illustrations

  5. Image processing - Erase content

  6. Natural language image search
  7. Generate Memory videos from images

Action execution

  1. Complete various tasks

Personal context understanding

  1. Cross-application content understanding

【Privacy protection (private)】

M series chips enable devices to perform local computations, or send data after desensitization to the Apple cloud for relevant processing. This is what is referred to as "private cloud compute."

【Siri】

Handles 1.5 billion requests a day.

With the application of AI technology, Siri will become more natural, relevant, and personalized:

  1. Becomes smarter through contextual understanding.
  2. Understands and processes the content on the screen.

Here's an example:

【chatGPT】

Siri and chatGPT combined can answer questions, understand images, and process documents.

【Developer】

The following functions can be obtained through the SDK:

  • Image Playground

  • Writing Tool

  • Siri

  • App Intents

【Release Time】

Apple Intelligence-supported devices include the iPhone 15 Pro, iPads with M chips, and Macs. U.S. users will begin using it in the summer, and starting in the fall, it will mainly be available on iOS 18 and macOS Sequoia systems (I've already upgraded my phone to iOS 18). Other languages will be supported next year.

【iPadOS】

MathNote

Not only can it handwrite mathematical formulas, but it can also automatically calculate the results.

SmartScript

It can intelligently convert handwritten notes into digital text and supports recognition in multiple languages.

【VisionOS】

Although VisionOS has little to do with AI, there are three functions that I really like:

Mac virtual display (Mac Virtual Display)

It can be used as a display for MacBook, which is very convenient.

Private Movie Theater

might buy a Vision Pro for this reason, so they won't feel eye strain from watching movies on a small screen while on a plane.

Spatial Video

You can really experience the feeling of being right there in the scene.