Google’s latest advancements in AI Mode and Search are poised to transform the way users interact with technology, making research, shopping, and more a seamless experience. With the integration of a custom version of Gemini’s 2.5 model, users can now pose more complex queries tailored to their specific needs. This week marks the beginning of a rollout that promises to enhance the capabilities of AI Mode, which will serve as the primary platform for these new features.
Google Search gets Project Astra
The introduction of Project Astra brings multimodal capabilities to Google Search, allowing users to engage in real-time conversations with Gemini while utilizing their device’s camera. This innovative feature enables users to discuss what they see, enhancing the search experience significantly. Furthermore, the integration of Project Mariner’s agentic capabilities means that the AI can now comprehend and process various elements of a website—ranging from images and text to code and pixels. This advancement allows the AI to perform tasks that typically require human input, such as adding items to a shopping cart or creating travel itineraries.
For example, users can simply ask AI Mode to find two tickets for a soccer game on Saturday, specifying their preferred seating arrangements. The AI will then present multiple options from various websites that meet these criteria, streamlining the process and saving valuable time.
AI Mode is also set to enhance its integration with other Google applications, resulting in a more personalized search experience. Users can inquire about activities in Toronto tailored to specific interests, such as Harry Potter-themed events or culinary experiences. The AI will respond with curated suggestions, including themed cafes, parties, hotel recommendations, and ticket options, all adjustable through Search’s personalization settings.
In addition to these features, Google is committed to revolutionizing online shopping through AI Mode. By combining the Gemini model’s capabilities with the Shopping Graph, users can browse for inspiration and refine their product choices. For instance, if a user expresses interest in a cute travel bag, AI Mode will present a visually engaging panel of images and product listings that align with their preferences.
Moreover, the virtual “try-on” feature allows users to upload a photo of themselves to experiment with outfits before making a purchase. Once they find the perfect ensemble, AI Mode facilitates the buying process by allowing users to set their desired price and options. Users can opt to track prices on product listings, receiving notifications for any price drops. When ready to make a purchase, users can confirm their details and simply tap “buy for me.” Behind the scenes, AI Mode will securely add the item to the cart on the merchant’s site and complete the checkout process using Google Pay, all under the user’s supervision.
This virtual try-on experience is currently being rolled out in Search Labs for U.S. users, with AI Mode becoming available to all users in the U.S. today. The new features will gradually be introduced to Lab Users in the upcoming weeks, marking a significant step forward in the integration of AI technology into everyday tasks.
