Microsoft has unveiled a series of enhancements to its Copilot application, with the latest features now beginning to roll out to Windows Insiders. Among these updates is the introduction of Copilot Vision and an advanced file search capability, which significantly enhances the AI’s ability to engage with the content on users’ PCs.
Enhanced Interaction with Copilot Vision
Copilot Vision, which made its debut on the web last year, is now integrated into the Windows app. This innovative feature allows the AI to “see” what is displayed on the user’s screen. As a result, users can inquire about the websites they are browsing, the documents they are editing, or even the music they are listening to, all without the need for screenshots or cumbersome copy-pasting.
While this functionality bears some resemblance to the Windows Recall feature, which is still undergoing limited testing, it raises important considerations regarding privacy. Microsoft assures users that they will maintain full control over what information is accessible, with all data being deleted after each session of Copilot Vision.
Microsoft envisions users leveraging Copilot Vision for various tasks, such as planning trips or seeking assistance while shopping online. The AI’s ability to perceive the user’s screen allows it to provide tailored suggestions and feedback, primarily through voice interactions.
Streamlined File Search Capabilities
In addition to Copilot Vision, the updated file search feature enables the AI to locate, open, and discuss files stored locally on the user’s system. For instance, users can easily request their résumé or retrieve a slideshow created last month, all through natural language queries.
Moreover, users can ask Copilot about the contents of their files, such as extracting spending figures from a spreadsheet. Microsoft emphasizes that users will have complete control over the permissions set for Copilot, ensuring that access to files is managed through the application’s settings.
How to Start Testing
These features are expected to be rolled out to the stable version of Windows for all users in due course, although a specific timeline has yet to be announced. For those eager to experience these new capabilities ahead of the general release, signing up for the Windows Insider Program is a viable option.
Participation in the Windows Insider Program is free and offers early access to new features, albeit with the possibility of encountering some bugs. It is advisable not to run Insider versions on devices critical to daily operations.
Once registered as a Windows Insider, users can opt into the beta channel of Windows 11 via the Windows Update section in Settings. Following this, a new download will be available to install the beta version on their computers, with the option to revert to the stable version at any time.
To utilize the latest Copilot features, users should ensure they have version 1.25034.133.0 or later installed from the Microsoft Store. Initially, these features will be available to Insiders in the U.S., with a gradual rollout to other regions to follow.
Launching Copilot Vision is straightforward: users simply click the glasses icon next to the main input box within the Copilot app. They will then be prompted to select the app or browser window to share with Copilot, allowing for voice interactions. To conclude a session, users can click the Stop or X buttons.
File search is seamlessly integrated into the Copilot app, enabling users to type or speak their queries as they would in any chat. For example, one might ask, “What were the places I shortlisted in my vacation plan document last week?” As always with AI, it is prudent to verify any critical information received.
