NPUs

Winsage
July 24, 2025
The adoption of AI-powered personal computers is expected to increase significantly in the coming year, driven by Qualcomm's announcement of new AI chips for affordable models priced around 0. Despite the slower evolution of AI software compared to hardware, the relevance of AI in computing is growing, with many applications utilizing AI hardware or neural processing units (NPUs). Microsoft has introduced Copilot+ PCs to promote generative AI tools and encourage the acquisition of Windows 11-compatible hardware. Major chip manufacturers like Intel, Qualcomm, and AMD are developing processors with AI capabilities for these PCs, indicating a shift in the computing landscape.
Winsage
June 26, 2025
Organizations must transition to Windows 11 Pro by October 14, 2025, as Windows 10 will no longer receive security updates, increasing vulnerability to cyber threats. The upgrade is complimentary for eligible Windows 10 devices, but compatible hardware is necessary to utilize enhanced security and performance features. Windows 11 Pro PCs include built-in security tools like Windows Hello, BitLocker encryption, and TPM 2.0. Windows AI PCs feature intelligent tools like Windows Copilot for improved efficiency, while Copilot+ PCs, launching in mid-2024, will have dedicated AI processors for advanced capabilities. Security features such as Secure Boot, Virtualization-Based Security, and BitLocker encryption are integral to Windows 11 Pro devices, mitigating risks of malware and unauthorized access. Upgrading to Windows 11 Pro enhances device stability and aligns with sustainability goals through energy-efficient designs.
Winsage
June 25, 2025
Microsoft Corporation unveiled a small language model named Mu on June 23, designed for local operation on personal computers, particularly Copilot+ PCs. Mu is a 330 million parameter encoder-decoder language model optimized for deployment on Neural Processing Units (NPUs), allowing for quick responses with reduced power consumption and memory usage. It was pre-trained on a dataset of hundreds of billions of educational tokens and employs advanced fine-tuning techniques, including distillation and low-rank adaptation, along with transformer enhancements like Dual LayerNorm, Rotary Positional Embeddings, and Grouped-Query Attention. Users will access Mu's capabilities through the Windows operating system's Settings function, translating natural language inputs into system commands.
Winsage
June 25, 2025
Microsoft has introduced a small language model named "Mu" to enhance AI agents in the Windows 11 Settings app. This model operates on Neural Processing Units (NPUs) and is designed to automate tasks on users' PCs with granted permissions. Mu was developed with attention to NPU memory constraints, ensuring efficient operation through NPU-optimized processes. The model aims for ultra-low latency, achieving response times under 500 milliseconds, and is integrated into the search box of the Settings app. Currently, AI agents powered by Mu are being tested among Windows Insiders, who can also explore an update to the Recall app.
Winsage
May 13, 2025
The current landscape of artificial intelligence interactions includes cloud-based tools like ChatGPT and Copilot, but some users, especially developers, prefer running large language models (LLMs) locally. Ollama provides a solution for this preference. To run LLMs effectively, hardware requirements include a GPU, with larger models needing more computational power. For example, Google's Gemma 3 has a 1 billion parameter model requiring 2.3GB of VRAM and a 4 billion parameter version needing over 9GB. Meta's Llama 3.2 has similar requirements. A modern PC with at least 8GB of RAM and a dedicated GPU can utilize Ollama. To install Ollama on Windows 11, users download the installer from the official website or GitHub and follow the installation process. Once installed, it operates in the background, indicated by an icon in the taskbar, and can be accessed via localhost:11434 in a web browser. Ollama primarily uses a command-line interface (CLI), requiring users to use PowerShell or WSL. Key commands include "ollama pull" to install LLMs and "ollama run" to execute them. For instance, to install the 1 billion parameter Google Gemma 3 LLM, users would enter "ollama pull gemma3:1b". Running the models opens a chatbot interface for user interaction, and exiting can be done by typing "/bye". Setting up Ollama is user-friendly and requires minimal technical expertise.
Winsage
April 11, 2025
Microsoft's latest update for Windows 11 Beta introduces the ability to read MSN articles directly from the Widgets feed, allowing users to access full articles, slideshows, and videos without using a browser. Users can customize the visibility of the MSN feed on their Widgets board. The update also enhances Copilot+ PCs with an AI-powered semantic search bar for natural language queries and improves the Narrator feature, which now analyzes screen content to provide descriptions of images and visual elements for visually impaired users.
Winsage
April 11, 2025
Microsoft is testing its Recall feature for Windows 11 in the Release Preview channel with build version 26100.3902. Recall is designed for Copilot+ PCs with powerful neural processing units (NPUs) and will initially support English, Chinese (Simplified), French, German, Japanese, and Spanish. The feature uses AI to analyze screenshots of user activity, allowing for natural language searches. Microsoft has implemented security measures like Windows Hello sign-in to address privacy concerns. Recall is expected to be available in early 2025 in most markets, but not in Europe during the initial rollout, due to data regulations.
Winsage
April 11, 2025
Microsoft has begun rolling out the Recall feature in Insider build version 26100.3902 after addressing previous security vulnerabilities. The Recall feature uses Neural Processing Units (NPUs) in Copilot+ PCs to capture screenshots and convert them into natural language descriptions for improved productivity. The new build also introduces the Click to Do feature for Snapdragon-powered PCs, enhances Phone Link functionality for easier content sharing, and includes the Windows Share feature for quick image edits before sharing. The rollout of these features will be gradual.
Search