Apple is pushing visual intelligence features that build on Apple Intelligence, allowing users to go beyond searching for context using their device’s camera and now also “search and take action on anything they’re viewing across their apps.” The feature can also recognize when a user is looking at something they may like to attend and pre-populate a calendar event with time and place.
“Users can ask ChatGPT questions about what they’re looking at on their screen to learn more, as well as search Google, Etsy, or other supported apps to find similar images and products,” according to Apple. To access the feature, a user can act like they’re taking a screenshot — they will then be prompted to either save the screenshot or search using Apple Intelligence.











