Google is making strides in enhancing its AI model, Gemini, with the development of three new extensions aimed at providing users with improved hands-free control. Recent investigations into the app’s code by AssembleDebug and Android Authority have revealed intriguing details about these forthcoming features.
What you need to know
- Google is working on three new extensions for its AI model, Gemini, to enhance hands-free user control.
- One of these extensions is linked to Google Home, allowing users to manage all connected devices within their account via Gemini.
- In a strategic move, Google is gradually integrating Gemini’s functionalities into its Assistant, signaling a shift away from the Assistant on Android devices.
The deep dive into the beta version v15.29.34.29 of the Google app has unearthed a promising Google Home AI extension. This feature aims to streamline the management of smart home devices, eliminating the need for Google Assistant, which has been a slight barrier in the current Android setup. Users will soon be able to control their homes and devices seamlessly through Gemini.
However, the Home extension comes with a caveat: some user data may be shared with Google if included in conversations. Fortunately, this feature is opt-in, allowing users the choice to disable it if they prefer.
In addition to the Home extension, another feature dubbed “Utilities” is in the works. This extension is designed to empower Gemini with the ability to control various functions of an Android phone, such as taking photos and opening apps, thereby enhancing user interaction.
Moreover, a third extension named “Phone” is expected to enable Gemini to assist users with making phone calls. Speculation suggests that users will simply need to type a command like “Call (name of the person)” to initiate a call, further simplifying communication.
Google began rolling out Gemini’s extensions in April, allowing users to leverage data across various applications, including Gmail, YouTube, Flights, and Hotels. This initiative is part of a broader strategy to phase out the traditional Assistant in favor of the more advanced, multimodal capabilities of Gemini.
Recent findings also indicate plans to integrate Gemini into Android’s lock screen, alongside the utilization of these extensions. While the exact timeline for the release of these features remains uncertain, anticipation is building as Google gears up for its hardware event on August 13, where new products, including the Pixel 9 series, are expected to be unveiled. It is plausible that the next phase for Gemini will be showcased during this event.
