Get ready for a smarter camera experience on your iPhone! During the recent WWDC 2026 keynote, Apple unveiled the integration of Siri's Visual Intelligence feature directly into the Camera app with the upcoming iOS 27. This innovative capability will allow users to point their camera at real-world objects and receive detailed information, mirroring functionalities similar to Google Lens. To access this feature, users will need an iPhone 15 Pro or newer, which includes all devices from the iPhone 16 and iPhone 17 families.
In an exciting expansion, Visual Intelligence will also debut on Mac with macOS 27, allowing users to highlight details within images. This means you can easily identify landmarks or find where to purchase specific clothing items. As with the iPhone, this feature requires a Mac that supports Apple Intelligence, specifically M-series laptops or iMacs.
Upgrades to Visual Intelligence on iPhone and iPad
iOS 27 will see several enhancements to Visual Intelligence as part of a broader Siri update. Users will be able to engage Siri directly through the Camera app, asking it to provide useful information about objects in view. This new "Siri mode" will be conveniently located between the Photo and Portrait modes. Additionally, users can now ask follow-up questions and see their previous inquiries in the new Siri app, ensuring that valuable information is retained even after closing the Camera app.
Siri mode will also offer relevant suggestions based on what the camera is focused on. For instance, during demonstrations, Siri was shown identifying a restaurant bill and facilitating easy cost-splitting among friends. On the iPad, Visual Intelligence will enhance the screenshot experience, allowing users to analyze content every time they capture a screenshot.
Moreover, Visual Intelligence is set to make its way to visionOS, the operating system for the Apple Vision headset, expanding its capabilities even further.
Functionality of Visual Intelligence in macOS 27 Golden Gate
Apple detailed how Visual Intelligence will operate on Mac in macOS 27, referred to as "Golden Gate." Users can select any part of their screen to utilize Visual Intelligence, aligning with common practices of clipping and saving interesting content. By using a keyboard shortcut, users can access Visual Intelligence, which presents several options next to the selected image. They can ask Siri for more information, initiate a reverse image search, or seek contextual details about the item displayed.
For example, if you choose an image of a pizza, macOS 27 will provide options to look up the nutritional information for that specific type of pizza. Furthermore, Visual Intelligence can recognize a music festival poster and seamlessly add multiple events to your calendar. Currently, this feature is available exclusively on Macs set to English.
These advancements in AI integration signify a transformative leap in how users interact with technology, setting the stage for a future where information is more accessible and intuitive than ever before.