Apple’s Revolutionary Intelligence Suite Comes to iPhones and Macs

TL;DR:

• Apple announces “Apple Intelligence,” a new suite of AI features for iPhones, Macs, and iPads, set to roll out later this year.
• Siri gets a major upgrade, becoming more conversational and capable of performing tasks across apps, managing notifications, and summarizing text.
• Introducing “Genmoji” and Image Playground, AI-powered features that generate custom emojis and images on demand.
• Apple partners with OpenAI, integrating ChatGPT (GPT-4o) into Siri for enhanced query handling and access to paid features for subscribers.

Apple Unveils “Apple Intelligence”

At the Worldwide Developers Conference (WWDC) 2024, Apple unveiled “Apple Intelligence,” an innovative suite of artificial intelligence (AI) features designed for iPhones, Macs, and iPads. This groundbreaking development brings a more conversational Siri, custom AI-generated “Genmoji,” and access to OpenAI’s ChatGPT (GPT-4o) when Siri cannot handle specific requests.

Siri’s AI-Powered Upgrade

Starting this fall, Siri will become more intelligent and capable, managing tasks across apps, handling notifications, and summarizing text in mail and other apps. The new AI features will enable Siri to reference one app to perform actions in another, such as playing a podcast sent by a partner. Additionally, users can type to Siri instead of speaking, making it more convenient to use in various situations.

Apple emphasizes that many of these features will work on-device for privacy purposes. However, when dealing with more complex requests, the device will automatically send the request to the cloud for processing. Apple assures users that it will never store or access their data on its servers and will use “Private Cloud Compute” powered by Apple Silicon for processing.

Introducing “Genmoji” and Image Playground

Apple’s new AI-powered features include “Genmoji,” which generates custom emoji-like reactions on the fly. With Genmoji, users can create the perfect emoji for any situation. Furthermore, the new Image Playground feature in iOS 18 allows users to generate images in several apps or use its standalone app. Developers can also access an API to include Image Playground in their apps.

AI enhancements are coming to the Photos app as well, improving object recognition in images and enabling users to search for specific actions or objects. Apple is also adding features similar to Google’s Magic Eraser, such as the ability to erase a person from a photo.

Apple and OpenAI: A Powerful Partnership

In a significant move, Apple has partnered with OpenAI to integrate ChatGPT (GPT-4o) into Siri. When Siri cannot handle a request, it will ask the user’s permission to send questions, documents, or photos to ChatGPT. After processing the request, Siri will present the answers to the user.

ChatGPT will also be available in Apple’s system-wide AI writing tools and for image generation. Apple assures users that OpenAI will not store user requests, and while an account or payment is not required to use ChatGPT, subscribers can connect their accounts to access paid features within the built-in integrations.

Availability and Compatibility

The new AI features will be available on iPhone 15 Pro and 15 Pro Max, as well as iPads or Macs with M1 or later chips. The features will only work when the device’s language is set to English. Apple plans to roll out these features in iOS 18, iPadOS 18, and macOS Sequoia later this year.

Comment and Share

What do you think about Apple’s new AI features? Are you excited to try out the smarter Siri, create custom Genmojis, or use ChatGPT on your Apple devices? Share your thoughts in the comments below and don’t forget to subscribe for updates on AI and AGI developments at AI in Asia.

You may also like:

• Will Apple’s ChatGPT Partnership Revolutionise AI?
• Siri is Getting Smarter
• Your iPhone is About to Become an AI Phone

• To see Apple’s WWDC24 keynote tap here.