On a seemingly ordinary Tuesday, I found myself donning a pair of unassuming glasses, surrounded by representatives from Google and Samsung. As one of them began speaking in Spanish, I was pleasantly surprised to see her words translated into English subtitles hovering in mid-air. This unexpected feature elicited a chuckle from the group, marking the beginning of my journey into the realm of Android XR—a new mixed reality operating system designed for headsets and smart glasses.
Google’s foray into augmented reality is not without its history. The infamous Google Glass, which struggled to gain traction over a decade ago, has since been reimagined for enterprise use. However, the landscape has shifted dramatically with competitors like Apple’s Vision Pro and Meta’s Ray-Ban smart glasses making waves. In response, Google is re-entering the arena with Android XR, aiming to redefine our expectations of smart glasses.
Central to this initiative is Gemini, a multimodal AI that promises to enrich interactions with our surroundings. During the demo, I prompted Gemini to identify a yellow book on a shelf behind me—an inquiry that it answered correctly, despite my initial glance at the book being fleeting. This capability, combined with the platform’s compatibility with any mobile and tablet app from the Play Store, sets the stage for developers to create innovative experiences. While consumers will have to wait until 2025 for the launch of Samsung’s Project Moohan—an XR headset that will showcase the full potential of Android XR—the anticipation is palpable.
Project Moohan, which translates to “infinity” in Korean, is designed to blend augmented and virtual reality, offering a glimpse into what the future may hold. The headset’s lightweight design and optional light seal allow users to remain connected to their environment while enjoying immersive content. My initial experience with the resolution was underwhelming, but once the device calibrated to my pupillary distance, the visuals became strikingly clear.
As I navigated through the interface, I couldn’t shake the feeling of déjà vu. The eye calibration and app-launching gestures felt reminiscent of the Vision Pro experience. I found myself pondering how Google plans to differentiate its offerings in a crowded market.
The answer, it seems, lies in Gemini. Despite skepticism surrounding generative AI, the potential for seamless interaction within the XR space is compelling. Samsung’s EVP, Kihwan Kim, emphasized the importance of context-aware communication, suggesting that Gemini’s ability to understand individual user needs could redefine how we engage with augmented reality. For instance, I could simply say, “Take me to JYP Entertainment in Seoul,” and Gemini would effortlessly open Google Maps to guide me there.
Moreover, the integration of Gemini extends beyond mere navigation. I witnessed it summarize lengthy text messages and even switch languages on command. The prospect of having such intuitive interactions in real life is tantalizing, yet the challenge remains: how to make these headsets appealing to the average consumer.
While I found the glasses demo particularly captivating, the timeline for their release remains uncertain. Google is currently focused on collaborating with partners to bring hardware to market, and establishing cultural acceptance for these devices is crucial. Shahram Izadi, Google’s VP of AR and XR, articulated a three-pronged strategy for Android XR that includes fostering developer engagement, enhancing conversational experiences with Gemini, and promoting a diverse ecosystem of devices rather than a singular product.
As I listened to Kim and Izadi, I felt a mix of hope and caution. My experiences were carefully curated, devoid of the freedom to explore or experiment. Until consumers can interact with these technologies without constraints, skepticism will linger. Nevertheless, for that brief hour, I was transported into a world reminiscent of Tony Stark’s high-tech universe, with Gemini serving as my personal assistant. This glimpse into the future of XR and AI assistants has set a new benchmark for what we can expect from these technologies, leaving me eager for what lies ahead.
