New features are making their way to Android phones and Pixel devices, enhancing user experience with a range of updates. Among these enhancements are more descriptive video captions, an upgraded Lookout app powered by Gemini, and a Spotify extension for Gemini. Pixel users will also enjoy additional features, particularly with the Pixel 9 series.
Enhanced Video Captions
One of the standout features is the introduction of Expressive Captions, which aim to enrich the viewing experience by adding descriptive phrases that capture non-verbal moments in dialogue. Users can expect to see annotations like [gasp] or [applause] appearing across various platforms, including social media apps and video messages, wherever video captions are available.
Improvements to Lookout
In a move towards greater accessibility, Google is enhancing the Lookout app, which provides audio descriptions of photos and objects for individuals with low vision or blindness. The integration of the Gemini 1.5 model into the Image Q&A feature will allow for more detailed descriptions of images, continuing Google’s commitment to incorporating AI into its accessibility tools.
Gemini Assistant Expansions
On the AI front, Google is expanding the capabilities of Gemini Assistant with new extensions. A notable addition is the Spotify extension, enabling users to play music directly from Spotify through the assistant. This feature addresses a gap that has existed since Gemini’s launch, as similar functionalities have long been available in the standard Google Assistant. Additionally, Gemini will gain access to the Utilities extension, allowing it to perform tasks such as making phone calls, sending emails, and adjusting phone settings on behalf of the user.
Pixel 9 Features
For Pixel 9 owners, the December feature drop brings several enhancements. The call screening feature now includes contextual reply suggestions, allowing users to respond to callers without needing to pick up the phone. This update aims to streamline communication and improve user convenience.
Updates to the Screenshots App
The Screenshots app on Pixel 9 devices is also receiving notable updates. Users can now save searches made using the Circle to Search feature directly within the app, providing an organized way to keep track of previous queries. Furthermore, Gboard will suggest search phrases based on saved screenshots, enhancing the overall functionality of the app. Users who have saved tickets or credit cards in Google Wallet via screenshots will also be able to store those in the Screenshots app.
Additional features are being rolled out for previous-generation Pixel phones, including Identity Check, which adds an extra layer of security by requiring additional authentication when accessing sensitive settings in new locations. The updates for Pixel 6 and newer devices begin today, with other features being distributed through the Google Play Services framework.
Correction, December 5th: A previous version of this article stated that Android 15 was required for these updates; however, they are not linked to Android 15 and are supported by a range of earlier Android versions, depending on the specific feature.
