Apple's Revolutionary Intelligence Suite Comes to iPhones and Macs

TL;DR:

Apple announces "Apple Intelligence," a new suite of AI features for iPhones, Macs, and iPads, set to roll out later this year.,Siri gets a major upgrade, becoming more conversational and capable of performing tasks across apps, managing notifications, and summarizing text.,Introducing "Genmoji" and Image Playground, AI-powered features that generate custom emojis and images on demand.,Apple partners with OpenAI, integrating ChatGPT (GPT-4o) into Siri for enhanced query handling and access to paid features for subscribers.

Apple Unveils "Apple Intelligence"

At the Worldwide Developers Conference (WWDC) 2024, Apple unveiled "Apple Intelligence," an innovative suite of artificial intelligence (AI) features designed for iPhones, Macs, and iPads. This groundbreaking development brings a more conversational Siri, custom AI-generated "Genmoji," and access to OpenAI's ChatGPT (GPT-4o) when Siri cannot handle specific requests. For more on how other companies are integrating AI, check out Apple's AI Plan: Gemini Today, Siri Tomorrow?.

Siri's AI-Powered Upgrade

Starting this fall, Siri will become more intelligent and capable, managing tasks across apps, handling notifications, and summarizing text in mail and other apps. The new AI features will enable Siri to reference one app to perform actions in another, such as playing a podcast sent by a partner. Additionally, users can type to Siri instead of speaking, making it more convenient to use in various situations.

Apple emphasizes that many of these features will work on-device for privacy purposes. However, when dealing with more complex requests, the device will automatically send the request to the cloud for processing. Apple assures users that it will never store or access their data on its servers and will use "Private Cloud Compute" powered by Apple Silicon for processing. This focus on privacy aligns with broader discussions around ProSocial AI Is The New ESG.

Introducing "Genmoji" and Image Playground

Apple's new AI-powered features include "Genmoji," which generates custom emoji-like reactions on the fly. With Genmoji, users can create the perfect emoji for any situation. Furthermore, the new Image Playground feature in iOS 18 allows users to generate images in several apps or use its standalone app. Developers can also access an API to include Image Playground in their apps.

AI enhancements are coming to the Photos app as well, improving object recognition in images and enabling users to search for specific actions or objects. Apple is also adding features similar to Google's Magic Eraser, such as the ability to erase a person from a photo. For those interested in creative AI tools, our guide on How to Use Ideogram.ai offers more insights.

Apple and OpenAI: A Powerful Partnership

In a significant move, Apple has partnered with OpenAI to integrate ChatGPT (GPT-4o) into Siri. When Siri cannot handle a request, it will ask the user's permission to send questions, documents, or photos to ChatGPT. After processing the request, Siri will present the answers to the user.

ChatGPT will also be available in Apple's system-wide AI writing tools and for image generation. Apple assures users that OpenAI will not store user requests, and while an account or payment is not required to use ChatGPT, subscribers can connect their accounts to access paid features within the built-in integrations. This collaboration highlights the growing trend of embedding advanced AI models into consumer devices, a strategy also seen in Google's AI Overviews (with ads!) coming to APAC. The partnership between Apple and OpenAI is a significant event in the AI landscape, reflecting the increasing integration of large language models into everyday technology. For more technical details on GPT-4o, OpenAI's official announcement provides additional context OpenAI GPT-4o.

Availability and Compatibility

The new AI features will be available on iPhone 15 Pro and 15 Pro Max, as well as iPads or Macs with M1 or later chips. The features will only work when the device's language is set to English. Apple plans to roll out these features in iOS 18, iPadOS 18, and macOS Sequoia later this year.

Comment and Share

What do you think about Apple's new AI features? Are you excited to try out the smarter Siri, create custom Genmojis, or use ChatGPT on your Apple devices? Share your thoughts in the comments below and don't forget to Subscribe to our newsletter for updates on AI and AGI developments at AI in Asia.