Google's AI Mode Expands with Multimodal Google Lens Search for Enhanced Visual Queries

Google has expanded access to its AI Mode, which was initially available only to Google One AI Premium subscribers, to millions more Labs users in the U.S. who are not paying for the service. The update also includes the integration of Google Lens, enabling multimodal input and understanding. Users can now take new photos or upload existing images to ask complex questions about what they see. This is powered by Gemini’s multimodal capabilities, which allow AI Mode to understand scenes in images, including object relationships, materials, colors, shapes, and arrangements. The feature uses a query fan-out technique to provide contextually relevant responses. For example, it can identify books on a shelf, recommend similar highly-rated books, and provide links to learn more or purchase them. Users can ask follow-up questions as well. Google Lens in AI Mode is now available on both Android and iOS devices. After one month of public testing, users have praised the clean design, fast response time, and ability to understand complex queries. AI Mode is being used for exploratory questions and complicated tasks such as product comparisons, how-tos, and trip planning.