Generative AI continues to evolve, with many companies, including Microsoft, actively refining their offerings before a broader public release. On Tuesday, Microsoft introduced a suite of updates to its Copilot platform, featuring innovative tools such as Copilot Voice, Think Deeper, and Copilot Vision. However, these enhancements will initially be available only to select testing groups through a new initiative called Copilot Labs.
Copilot Labs is designed to function similarly to Google Labs, providing a dedicated space for experimental features still in development. This allows users to engage with these tools, offer feedback, and contribute to the iterative process of product enhancement. At launch, Copilot Labs will showcase two pioneering features: Copilot Vision and Think Deeper, both aimed at enriching user assistance.
Copilot Vision
Copilot Vision represents a significant leap forward, enabling the Copilot within Microsoft Edge to visually interpret what is displayed on a user’s screen. This feature offers real-time voice assistance, taking into account both textual and visual elements. During a recent demonstration at the NYC Microsoft Copilot and Windows Event, the practical applications of this feature became evident.
In the demo, a user sought outfit inspiration from Pinterest. Copilot Vision not only suggested potential outfits but also provided encouragement when the user expressed doubt about their ability to pull off a particular look. This blend of visual context and interactive support illustrates the potential of Copilot Vision to enhance everyday decision-making.
To address concerns regarding privacy, Microsoft has assured users that participation in Copilot Vision sessions is opt-in. Furthermore, the sessions will not be stored for training purposes, will not function on all websites or paywalled content, and will focus on interpreting site content in real-time alongside the user.
Think Deeper
The Think Deeper feature allows Copilot to take a more deliberate approach when responding to complex inquiries. By extending response times, Copilot can provide detailed, step-by-step answers to challenging questions. Although still in its nascent stages, this feature is currently accessible exclusively through Copilot Labs. For users eager to explore similar capabilities, OpenAI’s o1-model in ChatGPT offers a comparable experience, albeit at a cost of per month for a ChatGPT Plus subscription.
How to access
It’s important to note that access to Copilot Labs is limited to Copilot Pro users, who must subscribe at a rate of per month. This subscription includes additional benefits, such as priority access to the latest models during peak times and integration with applications like Word, Excel (in preview), PowerPoint, and Outlook. For those who prefer a no-cost alternative, Google Labs remains a viable option for experimenting with AI features without the need for a subscription.
