What to expect from Apple's AI-powered iOS 18 at WWDC 2024
What are the new capabilities and features anticipated for Apple Photos with the integration of generative AI technology?
The integration of generative AI technology in Apple Photos is expected to bring several new capabilities and features. One of the most notable additions is the ability to retouch photos with AI, which could challenge Google Photos in this area. With the help of generative AI technology, users will be able to remove objects from their photos using a "Clean Up" feature, similar to Google's Magic Eraser. Additionally, Apple has developed an internal-only application called Generative Playground, which uses GenAI to create and edit images. While it's currently unclear how this functionality will be presented to end users, iMessage integration has been spotted in the form of an app extension. These new AI-powered features aim to enhance the overall photo editing experience for Apple users, allowing them to create more polished and personalized images with ease.
How will Apple's new Ajax LLM contribute to the AI features in iOS 18, and what are the implications for data privacy according to the company's plans?
Apple's new Ajax LLM (Large Language Model) is expected to significantly enhance the AI features in iOS 18 by powering a range of improvements across various built-in system apps such as Siri, Spotlight Search, Messages, Mail, and Safari6.
One of the primary areas Ajax LLM will contribute to is text summarization and analysis. This feature will allow users to get concise summaries of web pages in Safari, assisting users in quickly understanding the main points of the content. Additionally, it will enable users to analyze and summarize texts within the Messages app, simplifying complex conversations and providing generated responses to messages.
Furthermore, Ajax LLM will enhance Spotlight Search, making it smarter and more intuitive. The search functionality is expected to deliver faster and more relevant results, improving the user experience.
Apple is also focusing on data privacy with its Ajax LLM. The company plans to process data from AI in a way that even employees won't be able to access it1. This approach aims to protect user privacy by keeping data secure and not sending it to cloud-based servers for processing. By handling a lot of the AI processing on-device, Apple ensures that users' data doesn't go wandering off, reducing the risk of leaks and breaches.
In summary, Apple's new Ajax LLM will contribute to the AI features in iOS 18 by enhancing text summarization, analysis, and search capabilities across various built-in system apps. Additionally, Apple's focus on data privacy means that the AI processing will happen on-device, ensuring user data remains private and secure5.
What specific AI enhancements will Siri receive in the next update, and how will these changes improve user interaction with applications?
In the next update, Siri is set to receive several AI enhancements that will significantly improve user interaction with applications. Some of the specific AI enhancements include:
-
Control over individual app features: Siri will be able to control specific features within apps, allowing users to perform tasks like opening documents, moving notes to folders, or deleting emails without manually navigating the app.
-
Siri's integration with Apple's LLM (Large Language Model): Siri will use Apple's on-device LLM to process and understand user requests more naturally and efficiently. This will enable Siri to handle more complex tasks and provide more accurate responses.
-
Automatic feature enablement: Apple plans to use AI to analyze what users are doing on their devices and automatically enable relevant Siri features, making the user experience more seamless.
-
Improved voice quality: Siri will receive more natural-sounding voices, enhancing the overall user experience.
-
Notification summarization: Siri will be able to summarize notifications, taking into account entities such as people, companies, calendar events, locations, and dates.
-
Multiple command handling: In the future, Siri will be able to handle multiple tasks in a single request, such as asking Siri to summarize a recorded meeting and then send it to a specific set of colleagues.
These enhancements will make Siri more powerful and efficient, enabling users to interact with applications more easily and intuitively. By leveraging AI technology, Siri will become a more integral part of the user experience on Apple devices, ultimately improving the overall functionality and usability of various apps.