Apple has introduced a suite of innovative AI updates across its applications, enhancing functionality and user experience. Key features include smarter tab management in Safari, streamlined password updates, and improved cross-app context awareness.
With the new AI-driven tab management in Safari, users can expect automatic grouping of tabs by topic, along with suggestions for related tabs. A newly integrated page monitor will alert users to changes in web pages, making it easier to keep track of important updates like price changes or news articles. Additionally, Safari will now allow users to create custom extensions through simple text prompts, a task that previously required developer expertise.
Another significant improvement is the one-tap password update feature, which enables users to change compromised passwords effortlessly. Apple's AI handles the entire process, eliminating the need for manual logins.
In the Messages app, AI-generated reply suggestions and a feature to locate photos based on text descriptions will enhance communication efficiency. Users can now create calendar events using natural language, simply by mentioning participants and times, allowing Apple Intelligence to manage the details.
A particularly noteworthy update for power users is the Phone app's ability to pull contextual information from other applications during calls. For example, if you're speaking with an airline, it can retrieve your flight details from your email in real time. This functionality positions Apple in direct competition with Google's "Magic Cue" feature, highlighting a growing trend in AI integration at the operating system level.
The Shortcuts app is also receiving a major overhaul, now enabling users to create workflows by describing their needs in plain language. This shift towards "vibe-coding" makes automation accessible to a broader audience.
Furthermore, the Image Playground is set for a significant upgrade, featuring enhanced natural-language editing capabilities and a new model for generating photorealistic images. Users can now select and edit specific objects within images, and adjust dimensions for various formats. This feature is expected to attract developers once Apple releases a new API for third-party image generation.
Finally, Apple is enhancing its Photos cleanup tool with improved object removal and an AI-powered expansion feature that can extend image edges. The new Spatial Reframing tool allows users to reposition subjects within photos, utilizing on-device spatial models to convincingly fill in the new perspectives. Remarkably, this functionality also applies to older photos, suggesting that users' existing libraries can benefit from these advanced editing capabilities.
