Gemini AI's Real-Time Screen and Camera Access Rolled Out...

Google has confirmed the rollout of new AI features to Gemini Live. These features enable Gemini to see your screen or through your smartphone camera and answer questions about either in real-time. The features were first demonstrated as part of Project Astra nearly a year ago. A user on Reddit reported the feature appearing on their Xiaomi phone, with a video demonstrating Gemini's new screen-reading ability. Another Astra capability now rolling out is live video, allowing Gemini to interpret the feed from your smartphone camera in real-time and answer questions about it. Google's rollout of these features is a significant step forward in AI assistant technology, as competitors Amazon and Apple are still preparing their respective upgraded versions, while Samsung continues to use Gemini as the default assistant on its phones.

Read more at source.

Project Astra and Gemini's New Capabilities

Google first demonstrated the capabilities of Project Astra nearly a year ago. Project Astra powers the new features of Gemini Live, including screen-reading and real-time interpretation of smartphone camera feeds. These features are now available to Gemini Advanced Subscribers as part of the Google One AI Premium plan.

Gemini's Edge Over Competitors

Google's rollout of these features puts it ahead of competitors like Amazon and Apple, who are still preparing their respective AI assistant upgrades. Meanwhile, Samsung continues to use Gemini as the default assistant on its phones, further cementing Gemini's position in the market.