Google Lens Introduces Screen Search on iOS Chrome, Expanding AI Image Recognition

Overview

• New Feature on iOS: Google is integrating its Lens visual search more deeply into Chrome for iOS, introducing a new feature called 'Screen Search.' This functionality allows users to search the contents of their screen while browsing the web or watching videos.
• How It Works: Users can access Screen Search via the three-dot overflow menu in Chrome. They will see a shimmer effect on the screen and can circle or tap areas to search, with results appearing in a bottom sheet. Highlighting text is also supported.
• Similarities to Android: This feature mirrors the 'Circle to Search' functionality available on Android and is also coming to the Google app on iOS as 'Search this Screen.'
• Rollout: The feature is rolling out with Chrome 133 for iOS and the latest version of the Google app.
• Enhanced Recognition: Google has enhanced Lens's ability to recognize unique images using advanced AI models. This expanded recognition will provide more detailed information, including AI Overviews, without users needing to append questions.
• Availability: Expanded recognition is rolling out this week for English-language users in countries where AI Overviews are available. It will first be available in the Google app on Android and iOS, followed by the desktop and mobile Chrome version.