Windows 11 24H2 has made a significant leap forward with the rollout of its latest update, introducing a suite of AI features designed to enhance user experience. Initially launched with Copilot+ PCs, the update is now accessible to all users, bringing with it a range of innovative tools that promise to redefine how we interact with our devices.
Previously, Microsoft unveiled several AI-driven features such as Cocreator in Paint, Restyle in Photos, Live Captions, and Windows Studio Effects, all of which were exclusive to Copilot+ PCs equipped with a Neural Processing Unit (NPU). While the much-anticipated Recall feature was part of the initial rollout, it was subsequently retracted due to concerns over privacy and security protocols.
For those unfamiliar with the term, a Copilot+ PC refers to a new generation of computers that incorporate AI-capable hardware, including an NPU for efficient AI task processing. Initially, these PCs were limited to those powered by Qualcomm processors, but the lineup is expanding to include options from Intel and AMD.
Starting November 1, 2024, Microsoft will begin a phased rollout of additional AI features, although not all will be available immediately, as the deployment will occur selectively across different regions. Here’s a closer look at some of the exciting new functionalities on the horizon:
1. Click to Do
The Click to Do feature introduces an intuitive overlay that appears at the top of your screen when activated. This AI-powered assistant analyzes on-screen content, providing users with quick access to various tools. For instance, while viewing an image, users can right-click to reveal options such as Bing image search, save, share, and editing features like background blurring or object removal. This seamless integration allows for a more fluid workflow, as actions are processed locally and open in the relevant applications.
Additionally, Microsoft is testing features like “Summarization” and “Reword,” which will complement Click to Do when selecting text. The official launch of Click to Do is anticipated in November.
2. Super-resolution in Photos
In a bid to enhance its photo editing capabilities, Microsoft is introducing a Super-resolution feature in the Photos app. This tool allows users to upscale images by up to eight times their original resolution using a simple slider. Leveraging local AI models, Super-resolution aims to deliver high-quality enhancements to your images.
3. Generative Erase and Fill in Paint
Paint is set to receive a transformative update with the addition of generative erase and fill features. Users will be able to select and erase elements from images, blending the background seamlessly as if the removed object was never there. The fill feature will enable the addition of new elements to images, all processed instantaneously on Copilot+ PCs, ensuring a smooth user experience.
4. Improved Windows Search
Microsoft is enhancing the search functionality within File Explorer and Windows Search, allowing users to find files using natural language queries. For example, searching for images related to a past trip can be done by simply typing keywords like “railway” or “train,” even if the file names are not immediately recognizable. This feature will first roll out in File Explorer before being integrated into Windows Search and the Settings app.
5. Recall
After addressing previous security concerns, Windows Recall is making its return, initially available to Windows Insiders before a wider release. The revamped version is designed to be less invasive, ensuring that sensitive information is not recorded in snapshots. Users will have the option to configure settings to exclude specific apps, with all data stored locally. Unlike before, Recall will now be an opt-in feature, allowing users to choose whether to enable it during setup.
As Windows 11 24H2 unfolds, it’s clear that Microsoft is strategically differentiating its user base. While Copilot+ PC users will enjoy the full suite of AI features, standard users will continue to receive routine OS improvements. Without an NPU, the advanced AI functionalities will not perform optimally on traditional PCs, underscoring the importance of upgrading to a Copilot+ PC for those eager to explore these innovations.
