Exploring the Future of Visual Interaction with Gemini Live Astra’s World-Facing Camera [Video]
Experience the future of interactive AI with Gemini Live’s Astra-powered video features, now rolling out on select Android devices.
By Blip Tech
2 min read
Overview of Gemini Live Features
Gemini Live, powered by Astra, is expanding its visual functions on Android devices. This article provides a hands-on experience and highlights the key features, including world-facing camera usage and screen sharing capabilities.
Accessing Gemini Live Astra
- Subscription Requirement: Requires Google One AI Advanced subscription. Free trials are available for Pixel 9 Pro (12 months) and Galaxy S25 models (6 months).
- Launch via Gemini App: Launch the Gemini app to access new visual modes, which include camera and screen sharing controls.
- Voice Activation: Use the “Hey, Google” wake phrase or the 'Share screen with Live' button for AI-powered screen sharing.
User Experience
- Camera Functionality: The camera interface is user-friendly and familiar, resembling the Pixel camera UI. It supports both rear and front cameras but lacks zoom capabilities.
- Focus Issues: Focus can be finicky, especially for close-up subjects, requiring users to keep still or ensure the subject remains stationary.
- Use Cases: Best suited for deeper queries like object identification, food information, and real-time translations. On-screen text is not provided; responses are audio-based.
Screen Sharing
- Current Limitations: Shares the entire screen rather than a single app. Visual feedback is limited to audio cues and information.
- Potential Improvements: Future integrations may allow for adding items to shopping lists or calendar events directly from shared screens.
Accuracy and Considerations
- AI Limitations: Gemini can provide incorrect information, especially with less familiar objects. Clear views within the viewfinder help mitigate errors.
- Trust Issues: Users should not blindly trust AI information due to potential hallucinations and inaccuracies.
Future Prospects
- AR Integration: The current features are a step towards Google’s AR platform vision. While limited, they show promise for improvement and better integration with other services over time.
