on-device AI Archives

Winsage

March 26, 2025

Lilbits: AI-enhanced search for Windows PCs and Amazon’s Big Spring Sale

Recent advancements in laptop technology have introduced high-performance neural processing units from manufacturers like Intel, AMD, and Qualcomm, enabling on-device artificial intelligence applications. Microsoft initially planned to launch its Recall feature for Copilot+ PCs but delayed it due to privacy concerns. Microsoft is now testing a new AI-enhanced search function that allows users to search for files, settings, or documents by description. Additionally, Microsoft is rolling out Local Semantic Search to Windows Insiders with Intel or AMD-powered Copilot+ PCs, which allows searching by description in File Explorer, Windows Search, or Settings, and can be disabled for certain folders.

AppWizard

February 27, 2025

Google’s SafetyCore App Secretly Scans All Photos on Android Devices

Google's SafetyCore app was launched in October 2023 as part of system updates for Android devices, designed to classify content like spam and explicit material through on-device image analysis. It operates locally using machine learning, avoiding cloud uploads, and is promoted as a privacy-enhancing feature. However, it requires 2GB of storage and operates in the background without prior user disclosure, leading to criticism regarding its transparency and potential privacy implications. Users discovered its existence through online discussions, with some labeling it as "spyware." Although Google claims that SafetyCore only activates upon app requests and does not report findings back to the company, the closed-source nature of the app raises concerns about independent audits and user trust. Advocates for privacy emphasize the need for transparency in technology, especially regarding features that access personal data. Users can disable SafetyCore through the Settings menu, but many remain unaware of this option. The situation highlights a broader issue of balancing innovation with user consent in the tech industry.

Winsage

December 28, 2024

I’ve been a Windows on Arm user for years — Snapdragon X Elite has changed everything

The author has been using Arm-based computers, specifically an M1 Mac Mini and a Qualcomm Snapdragon-powered Windows two-in-one PC, and has found Apple's silicon consistently impressive while Microsoft's offerings have lagged. In April 2024, Microsoft introduced the Snapdragon X Elite and X Plus chipsets, enhancing the compatibility layer for applications on Windows on Arm through a new emulator called Prism, which matches the efficiency of Apple's Rosetta 2. Testing the Honor MagicBook 14 Art, powered by the Snapdragon X Elite, revealed significant improvements, including native support for previously struggling applications like Google Drive and ExpressVPN. The MagicBook features a 12-core Snapdragon X Elite, offering seamless application launch and multitasking without the random freezes seen in earlier models. Its thermal performance is commendable, achieving around ten hours of usage in "Balanced" mode. The device also includes a Neural Processing Unit for enhanced AI capabilities. Compatibility advancements allow mainstream applications to run natively, and upcoming Windows updates promise to expand this further. The MagicBook 14 Art is priced at approximately ,750, featuring 32GB of RAM, a 1TB SSD, and a detachable webcam for privacy. Despite the progress, the market for Snapdragon X computers remains niche, and Qualcomm's disputes with Arm could impact future sales.

Winsage

December 26, 2024

Hands on: Microsoft made it easier to run AI models on Windows 11 locally

Copilot+ PCs are the first personal computers to run Small Language Models (SLM) directly on-device, allowing for quicker interactions without relying on the cloud. Microsoft has introduced the AI Dev Gallery, which offers over 25 samples for developers to integrate on-device AI features into applications on Windows 10 and 11. The gallery requires building the project in Visual Studio, needing at least 20GB of storage and a multi-core CPU. A GPU with 8GB VRAM is recommended for heavier models but not mandatory for lighter applications. The app has two operational modes: Sample and Models. Testing models for image generation typically requires around 5GB of bandwidth, while a smaller image upscaling model under 100MB was successfully tested, completing the process in under 30 seconds with peak RAM usage of 1GB. The resulting image resolution was 9272x4900, but clarity issues were noted, especially with text. The application lacks features for previewing images in larger formats or downloading outputs directly. A model named Detect Human Pose was able to identify positions within images, including desktop screenshots. Substantial storage and robust CPUs are necessary for effective model accommodation, and the practicality of downloading large models for niche use cases is questioned.

Winsage

December 23, 2024

Microsoft Edge drops yellow for folders (favourites), gets monoline transparent look

Microsoft Edge has updated to version 131.0.2903.112, introducing a design shift that replaces the yellow-themed favorites folders with a monoline, transparent aesthetic. This change has received mixed reactions from users, with some expressing ambivalence and frustration over the lack of customization options. A temporary workaround exists for reverting to the classic yellow folder icons by modifying the msedge.exe shortcut. Additionally, Microsoft Edge is set to introduce new features, including pop-ups to encourage users to set it as the default browser and enhancements like on-device AI capabilities and improved PDF reading with OCR technology.

Winsage

December 21, 2024

How to get started with Windows Recall on Windows 11

Windows 11 version 24H2 introduces a feature called Windows Recall, which captures and remembers on-screen activities using AI. Users can configure settings for Windows Recall, including opting in or out, adjusting storage allocations (25GB for 256GB SSD, 75GB for 512GB SSD, and 150GB for 1TB SSD), deleting snapshots, and filtering specific apps and websites. The feature can filter sensitive information and allows users to pause and resume snapshots. Users can search for past activities using natural language queries and interact with snapshots to perform actions like copying text or erasing objects. Windows Recall operates only when the device is in use and does not upload data to the cloud. The data remains on the user's device, with encryption for security. The feature supports multiple languages, including English, Chinese, French, German, Japanese, and Spanish.

Winsage

December 14, 2024

Rising to the TOPS: How will NPUs and Windows AI grow in 2025?

In 2024, Microsoft introduced the "Copilot+ PC" branding for AI-capable laptops, while Apple launched Apple Intelligence. These developments have led to mixed outcomes, with features like real-time translations and on-device speech-to-text being beneficial, but others, such as Windows Recall, still proving their value. By 2025, mainstream developers are expected to integrate on-device AI into Windows applications, influencing consumer purchasing decisions. The term "TOPS" (Trillions of Operations Per Second) is becoming important for evaluating the AI performance of Windows laptops, with a minimum of 40 TOPS required for Microsoft's "Copilot PC+" designation. Qualcomm's Copilot+ PCs reported around 45 TOPS, significantly higher than Intel's 11 TOPS. By the end of 2024, premium Windows laptops are expected to see a three- to four-fold increase in NPU performance compared to 2023 models. Analysts speculate further performance improvements may occur towards the end of 2025. Despite the potential for a two- to three-fold enhancement in on-device AI performance, experts caution against overemphasizing TOPS figures, which may not accurately reflect real-world performance. The lack of a unified API for leveraging NPU capabilities in Windows complicates matters for users of Copilot+ laptops without Qualcomm chips. Although AMD and Intel have released competitive chips, Qualcomm currently holds an advantage with exclusive support for certain applications. Microsoft is promoting its low-level machine learning API (DirectML) and the Windows Copilot Runtime, which may enhance the Copilot+ PC ecosystem. While cloud-based AI solutions remain an option, the cost of these services is expected to rise, making on-device AI more appealing. The introduction of ChatGPT Pro highlights the financial implications of cloud access compared to on-device NPU usage, which incurs no additional costs. The pace of on-device AI adoption in Windows' software ecosystem is anticipated to accelerate in 2025.

Winsage

December 13, 2024

Windows Recall AI may sometimes capture intricate credit card details, even when Microsoft’s sensitive information filter is enabled in Windows 11

Windows Recall is a feature introduced in the Windows 11, version 24H2 update, exclusive to Copilot+ PCs, which captures snapshots of the user's screen at regular intervals and uses on-device AI to analyze the content. Microsoft has implemented a setting to filter out sensitive information from these snapshots, aiming to prevent the capture of data from applications or websites that handle sensitive information. However, a report indicated that Windows Recall still captured sensitive financial information, including credit card numbers, despite the filtering setting being enabled. Testing showed inconsistent results, as sensitive fields were captured in some contexts but not in others. Windows Recall is currently in beta and available through Microsoft's Windows 11 preview program, with Microsoft actively seeking user feedback to improve the feature before its official launch.

Winsage

December 7, 2024

These are my 15 favorite features and changes that Microsoft added to Windows 11 in 2024

- Windows 11 introduced the Sudo command, allowing users to execute commands with elevated privileges without launching the Windows Terminal as an administrator. - An "Energy Saver" mode was added to enhance power management, combining features of the previous "Battery Saver" and "Power Mode." - Users can now modify power button actions directly from Settings without accessing the legacy Control Panel. - The date and time format in the Taskbar's System Tray has been revised to omit the AM/PM designation and the four-digit year. - Taskbar navigation has been improved, allowing users to focus on applications using their initial letters. - Users can customize mouse scrolling direction via Settings without accessing the Registry. - Windows 11 now supports Wi-Fi 7, promising speeds exceeding 40 Gbps. - A network refresh button was added to the Quick Settings flyout for easier scanning of available wireless networks. - Auto Super Resolution (Auto SR) enhances gaming visuals on Copilot+ PCs by upscaling images and improving frame rates. - Windows Studio effects enhance video and audio calls with AI-driven features, now available to all Copilot+ PC users. - The context menu in File Explorer has been updated to include labels for commonly used actions. - A new archive compression wizard allows users to create Zip, TAR, and 7zip files. - The "Link to Windows" feature enables browsing and transferring files from Android devices to Windows 11 computers without a USB connection. - The "Windows Setup" interface has been revamped with a cleaner design and simplified installation process. - A customizable Copilot key option allows users to remap this key to any application from the Microsoft Store.

AppWizard

December 6, 2024

New Android Spyware Alert—Delete All These Apps Now

Samsung is tightening security measures against apps from unofficial app stores due to a newly discovered threat from a sophisticated malware called DroidBot. Cleafy, a cybersecurity firm, describes DroidBot as an advanced Android Remote Access Trojan (RAT) that combines traditional hidden VNC and overlay functionalities with spyware capabilities, including keylogging and data exfiltration. The malware has infected 77 applications, including those from banking institutions and cryptocurrency exchanges, and is present in countries such as the UK, Italy, France, Spain, and Portugal, with potential expansion into Latin America and the United States. DroidBot operates as Malware as a Service, available for rent to various threat actors, with 17 identified affiliate groups. It disguises itself as popular applications to entice users into downloading it and exploits permissions to operate covertly, particularly using Accessibility Services. Its functionalities include intercepting SMS messages, keylogging, and creating fake login screens to capture user credentials. Users are advised to avoid installing banking apps from unofficial sources, delete any malicious applications, and ensure their devices are secure by enabling Play Protect and keeping the operating system updated. Key safety measures include using official app stores, verifying app developers, being cautious with permissions, avoiding direct download links, and checking the legitimacy of apps claiming to link to established services.