What to expect from Apple's AI-powered iOS 18 at WWDC 2024
In what ways is Apple ensuring data privacy while implementing AI features in iOS 18?
Apple is reportedly taking several measures to ensure data privacy while implementing AI features in iOS 18. One significant approach is the use of on-device processing for AI-related tasks. This means that the data being processed stays on the user's device, reducing the risk of it being sent to Apple's servers or being accessed by unauthorized parties.
Furthermore, Apple is said to be utilizing its Ajax LLM (large language model) for some AI features, such as suggested email replies. The Ajax LLM operates on the device, enhancing data privacy by keeping the information local.
Another measure being taken by Apple is the implementation of a "confidential-computing approach." This approach involves using the Secure Enclave in Apple's M2 Ultra and M4 chips to process cloud AI requests6. The Secure Enclave is a part of the hardware in most Apple products, and its purpose is to store sensitive information, such as encryption keys and biometric data. By processing AI requests in the Secure Enclave, Apple aims to keep user data safe and encrypted, even when it is being processed in the cloud6.
These privacy measures are designed to protect user data from potential exposure to hackers, Apple employees, or other unauthorized parties. By focusing on on-device processing and utilizing the Secure Enclave, Apple aims to maintain its commitment to data privacy while still providing advanced AI features in iOS 18.
How will the new AI features in Apple Mail, such as suggested replies and enhanced search, improve email management for users?
The new AI features in Apple Mail, including suggested replies and enhanced search, are expected to significantly improve email management for users in several ways.
-
Suggested Replies: Apple Mail in iOS 18 is set to include a "Smart Reply" feature, which will leverage Apple's on-device large language model (LLM), known as Ajax15. This feature will generate instant AI-powered response suggestions based on the context of the email. Users can choose to send these pre-written responses, making it easier and quicker to reply to emails, especially for frequently asked questions or common queries5. This feature is particularly useful for businesses dealing with a high volume of customer emails, enabling them to respond more efficiently.
-
Email Tone Adjustment: Users will be able to ask Siri to adjust the tone of their emails5. For instance, they can request that a response is crafted in a more professional, friendly, or concise manner. This feature streamlines communication and saves time by eliminating the need to manually edit the email's tone.
-
Enhanced Search: The search functionality within Apple Mail is set to become more powerful4. It will include information from Contacts, locations, and locally stored documents, making it easier for users to find specific emails or related information.
-
Automatic Categorization: Emails will be automatically categorized based on their content, such as 'Commerce', 'News', 'Other', 'Promotions', 'Social', and 'Transaction'. This feature helps users to prioritize and manage their inbox more efficiently.
-
Email Summarization: iOS 18 is expected to support summarization in various parts of the system, including emails. This feature will allow users to read shorter versions of their emails, saving time and allowing for quicker comprehension of the content.
These AI-powered tools will significantly enhance the user experience in Apple Mail, making email management more efficient and intuitive.
What specific AI technologies is Apple integrating into iOS 18, and what are their expected impacts on user experience?
Apple is integrating several AI technologies into iOS 18, which are expected to have a significant impact on the user experience. Some of these AI technologies and their expected impacts include:
-
Siri's AI Revamp: Siri, Apple's digital assistant, will leverage Apple's own large language models (LLMs) and will allow Siri to control individual features inside applications. This will work without any necessary setup by developers or users. Users will be able to ask Siri to do things like delete an email or edit a photo. Siri will also receive more natural-sounding voices and the ability to summarize notifications.
-
Apple Photos' AI Integration: Users will have the ability to retouch photos with AI, perhaps challenging Google Photos in this area. A "Clean Up" feature would, for instance, let you remove objects from your photos using generative AI technology, similar to Google's Magic Eraser.
-
Safari with AI: AI recaps of Safari web pages and news articles will be available through a new Intelligent Search feature.
-
AI in Notes: Users will be able to ask for AI recaps of Notes. GenAI will also help to transcribe audio in Notes. In-app audio recording will be supported alongside audio transcription and AI summarization.
-
Voice Memos Transcriptions: Real-time transcription for voice memos is also coming.
-
AI in iMessages: Generative AI emojis will be supported, letting users create their own emojis with technology. AI recaps of missed texts will also be available.
-
AI in Calendar: Apple's LLM will be able to communicate with the Calendar app to check for events when composing responses to messages.
-
AI in Mail: Mail will get suggested email replies generated by Ajax. Search within Apple Mail will include information from Contacts, locations, and locally stored documents.
These AI technologies are expected to significantly enhance the user experience by making tasks easier, faster, and more efficient. Users can expect a more seamless and personalized experience with iOS 18.