desktop interaction

Microsoft's Copilot Vision tool has been updated to allow users to view their entire desktop, enhancing its previous capability of analyzing only two applications at once. Users can activate this feature by clicking the glasses icon in the Copilot app to select their desktop view. Copilot Vision provides real-time assistance by analyzing content, offering insights, and answering questions. It was initially tested for web browsing in Microsoft Edge and can now also respond to queries based on observations made through a mobile phone's camera.