on-device AI

AppWizard
May 16, 2025
Google is preparing to unveil new mobile AI tools at the upcoming I/O event, including a suite of APIs that will enable developers to use Gemini Nano for on-device AI applications. The ML Kit SDK will be updated to support on-device generative AI functionalities through Gemini Nano, which integrates with existing models and offers predefined features for ease of implementation. The ML Kit’s GenAI APIs will allow applications to perform tasks such as summarization, proofreading, rewriting, and image description without cloud data transmission. However, Gemini Nano's capabilities are limited compared to cloud-based options, with summaries restricted to three bullet points and image descriptions available only in English. The standard version, Gemini Nano XS, requires about 100MB of storage, while the smaller Gemini Nano XXS is text-only and occupies a quarter of that size. ML Kit is compatible with devices beyond Google's Pixel lineup, including the OnePlus 13, Samsung Galaxy S25, and Xiaomi 15, providing developers opportunities to enhance applications with generative AI features.
AppWizard
May 16, 2025
Google is expanding its Gemini Nano AI model by introducing new ML Kit GenAI APIs, expected to be unveiled at the I/O 2025 event. These APIs will allow developers to integrate features such as text summarization, proofreading, rewriting, and image description generation into their applications. Gemini Nano operates on devices, enhancing privacy by processing data locally. The ML Kit GenAI APIs will support various languages and functionalities, including generating concise summaries, correcting grammar, transforming chat messages, and providing image descriptions. Unlike the experimental AI Edge SDK, the GenAI APIs will be in beta, allowing for broader device compatibility beyond the Pixel 9 series, including other Android devices. Public documentation for the ML Kit GenAI APIs is now available for developers.
AppWizard
May 13, 2025
Google is deploying advanced artificial intelligence to identify and combat online scams across its platforms, including Chrome, Search, and Android. The AI technology enables Google to detect 20 times more scam-related pages than before. Chrome will now alert users to unwanted or harmful notifications from scam websites, allowing them to unsubscribe or view blocked content. The initiative utilizes Gemini's Nano, an on-device AI capable of identifying new scams. Google has also introduced AI-powered scam detection in Google Messages, which flags potential malicious users by scanning for scam-related phrases and patterns, allowing users to report and block suspicious contacts.
Winsage
May 7, 2025
Microsoft has introduced a suite of Windows experiences for Copilot+ PCs, featuring AI agents that help users adjust settings on their computers by interpreting user intent and automating tasks with consent. Users can communicate in natural language to receive guidance or have changes executed directly. This feature will initially be available to English-speaking Windows Insiders on Snapdragon-powered devices, with plans for broader support. Additionally, Microsoft is enhancing Windows search capabilities and expanding Click to Do actions, allowing users to schedule meetings, send messages, consult M365 Copilot, convert data in Excel, and draft documents in Word. Creative tools like Photos, Paint, and the Snipping Tool are receiving updates, including dynamic lighting controls in Photos, a sticker generator in Paint, and new capture capabilities in the Snipping Tool. Upcoming features for Windows 11 Insiders include a phone companion for the Start menu, AI-driven actions in File Explorer, and a new writing function in Notepad for generating text from prompts. Microsoft is also testing a "Draw & Hold" feature in the Snipping Tool and has introduced a text rewriting tool called "Rewrite."
AppWizard
April 15, 2025
Google is set to introduce Gemini support to Wear OS smartwatches, replacing the existing Google Assistant. This transition follows Google's plan to fully transition to Gemini, starting with Android phones and expanding to tablets, Android Auto, headphones, Nest speakers, Google TV, and smartwatches. Insights from 9to5Google suggest that Gemini may be a straightforward app enhancement rather than a radical overhaul. The Pixel 9a features a Tensor G4 chip but has limited AI capabilities due to its 8GB of RAM, while the Pixel Watch 3 has 2GB of RAM and older Arm Cortex cores, which may hinder Gemini's performance compared to Assistant. There is potential for improved interaction with applications through Gemini extensions, but true Gemini Live-style conversations on smartwatches may not be feasible without significant battery drain. Future iterations of the Pixel Watch may showcase enhanced Gemini capabilities, especially with a new Wear OS chip expected from Qualcomm, but Google's current focus is on ensuring Gemini operates effectively on existing Android watches.
Winsage
March 26, 2025
Recent advancements in laptop technology have introduced high-performance neural processing units from manufacturers like Intel, AMD, and Qualcomm, enabling on-device artificial intelligence applications. Microsoft initially planned to launch its Recall feature for Copilot+ PCs but delayed it due to privacy concerns. Microsoft is now testing a new AI-enhanced search function that allows users to search for files, settings, or documents by description. Additionally, Microsoft is rolling out Local Semantic Search to Windows Insiders with Intel or AMD-powered Copilot+ PCs, which allows searching by description in File Explorer, Windows Search, or Settings, and can be disabled for certain folders.
AppWizard
February 27, 2025
Google's SafetyCore app was launched in October 2023 as part of system updates for Android devices, designed to classify content like spam and explicit material through on-device image analysis. It operates locally using machine learning, avoiding cloud uploads, and is promoted as a privacy-enhancing feature. However, it requires 2GB of storage and operates in the background without prior user disclosure, leading to criticism regarding its transparency and potential privacy implications. Users discovered its existence through online discussions, with some labeling it as "spyware." Although Google claims that SafetyCore only activates upon app requests and does not report findings back to the company, the closed-source nature of the app raises concerns about independent audits and user trust. Advocates for privacy emphasize the need for transparency in technology, especially regarding features that access personal data. Users can disable SafetyCore through the Settings menu, but many remain unaware of this option. The situation highlights a broader issue of balancing innovation with user consent in the tech industry.
Winsage
December 28, 2024
The author has been using Arm-based computers, specifically an M1 Mac Mini and a Qualcomm Snapdragon-powered Windows two-in-one PC, and has found Apple's silicon consistently impressive while Microsoft's offerings have lagged. In April 2024, Microsoft introduced the Snapdragon X Elite and X Plus chipsets, enhancing the compatibility layer for applications on Windows on Arm through a new emulator called Prism, which matches the efficiency of Apple's Rosetta 2. Testing the Honor MagicBook 14 Art, powered by the Snapdragon X Elite, revealed significant improvements, including native support for previously struggling applications like Google Drive and ExpressVPN. The MagicBook features a 12-core Snapdragon X Elite, offering seamless application launch and multitasking without the random freezes seen in earlier models. Its thermal performance is commendable, achieving around ten hours of usage in "Balanced" mode. The device also includes a Neural Processing Unit for enhanced AI capabilities. Compatibility advancements allow mainstream applications to run natively, and upcoming Windows updates promise to expand this further. The MagicBook 14 Art is priced at approximately ,750, featuring 32GB of RAM, a 1TB SSD, and a detachable webcam for privacy. Despite the progress, the market for Snapdragon X computers remains niche, and Qualcomm's disputes with Arm could impact future sales.
Search