Gemini Live has evolved from a voice-based AI assistant into a sophisticated multimodal platform, now equipped with the ability to process both camera feeds and screen-sharing inputs. This enhancement allows users to engage in conversational interactions while simultaneously providing visual context, enriching the overall experience. The feature is accessible on nearly any Android device, provided users hold a Google One AI Premium subscription.
What you need to use Gemini Live with live video and screen sharing
The requirements for utilizing Gemini Live’s new capabilities are minimal, as the processing occurs off-device. Users need only an Android device with a minimum of 2 GB of RAM and running Android 10 or later. However, it is advisable to exercise caution regarding the information shared with Gemini Live, as data is transmitted to the cloud for analysis. Sensitive or personally identifiable information should be avoided.
To access the camera and screen-sharing features of Gemini Live, a Google One AI Premium subscription is necessary. Notably, these features are complimentary for users of the Google Pixel 9 and Samsung Galaxy S25 series. Additionally, those with newer Pixel devices may have received a trial period for Gemini Advanced, further enhancing accessibility.
How to share a live video feed with Gemini
With its new capabilities, Gemini Live can now incorporate visual elements from your environment into conversations. To share a live video feed, follow these steps:
- Launch Gemini by either opening the app or long-pressing the power button.
- Tap the Live icon located at the bottom of your screen.
- Select the Camera button.
- Ensure the items you wish to discuss are visible within the camera’s viewfinder.
- Begin asking questions about the objects in view.
Gemini excels at identifying items that may not be readily named, offering insights that traditional search methods might miss. For instance, when presented with an old iPod Shuffle, Gemini can provide information without requiring the user to know its name beforehand.
How to share your screen with Gemini
In addition to live video, users can share their screens with Gemini, facilitating a more interactive dialogue. Currently, Google allows sharing of the entire screen only, without the option to limit it to specific applications. To initiate screen sharing, follow these steps:
- Open the app, article, or screen you wish to discuss with Gemini Live.
- Long-press the power button to activate Gemini.
- Select Share screen with Live.
- Start asking Gemini Live questions related to your screen content.
Once your screen is shared, Gemini can summarize the displayed content, answer queries, and provide additional context, effectively merging the capabilities of voice interaction with visual aids.
When to use Gemini Live’s multimodal AI
The introduction of live video streaming and screen sharing enhances Gemini Live’s functionality, making it particularly useful in scenarios where detailed descriptions are necessary. Instead of relying solely on verbal explanations, users can visually demonstrate their inquiries, aligning Gemini with competitors like Meta AI and OpenAI’s GPT-4o.
Available on the latest Pixel and Galaxy devices, Gemini Live’s multimodal features offer a compelling advantage for users seeking a more integrated AI experience.
