Now Microsoft’s Copilot Vision AI can scan everything on your screen

Microsoft has unveiled an exciting update to its Copilot Vision tool, now available for Windows Insiders. This enhancement allows the AI assistant to gain a comprehensive view of your entire desktop, a significant upgrade from its previous capability of analyzing only two applications simultaneously. With this new functionality, users can expect a more seamless interaction as Copilot Vision can now engage with any specific browser or application window.

Unlike the Recall feature, which automatically captures snapshots of your screen, Copilot Vision operates more like a screen-sharing tool during a video call. Users can activate this feature by simply clicking the glasses icon within the Copilot app and selecting the desired desktop view. This intuitive approach enables a more interactive experience.

According to Microsoft, Copilot Vision is designed to assist users by analyzing content, providing insights, and answering questions in real-time. Whether you need tips for enhancing a creative project, assistance with resume improvements, or guidance while exploring a new game, Copilot Vision is positioned to offer valuable support.

This innovative tool was initially tested last year, focusing on its ability to observe user activity while browsing the web in Microsoft Edge. Additionally, Copilot Vision extends its capabilities beyond the desktop, allowing users to pose questions about what the AI observes through their mobile phone’s camera, further bridging the gap between digital interaction and real-world context.

Winsage
Now Microsoft’s Copilot Vision AI can scan everything on your screen