local models

NVIDIA has enhanced the capability to run AI agents locally on its hardware in collaboration with Microsoft and software partners, coinciding with the launch of new RTX Spark Windows PCs. The installation process for local agent software has been simplified, with improved inference speeds and the introduction of NVIDIA PAIR, which distributes inference tasks across multiple PCs on a local network. Three applications benefiting from these enhancements are Hermes Agent, OpenClaw, and Perplexity Portable Computer, all designed to minimize manual configuration. Hermes Agent offers a one-click local setup for RTX and DGX systems, automatically detecting the GPU and optimizing model selection. OpenClaw simplifies local model setups for RTX GPUs with at least 24GB of VRAM, backed by an open-source community. Perplexity Portable Computer, already available on Linux, is extending support to NVIDIA RTX GPUs and Windows. NVIDIA is also improving performance in the open-source inference stack, achieving throughput increases of up to 1.9 times on GeForce RTX 5090 and up to 1.4 times on DGX Spark clusters. The PAIR software identifies compatible PCs on the same network to optimize computing resources, supporting various hardware configurations. The upcoming RTX Spark Windows PCs, set to launch in October, will include compact desktop and laptop designs featuring Blackwell GPU and Grace CPU architecture. Game publishers like Electronic Arts and Ubisoft are developing titles for these systems. Additionally, CyberLink's PhotoDirector AI PC Mode will integrate local AI processing for creative tasks, emphasizing the trend of migrating generative AI workloads from cloud to local devices. NVIDIA notes that over half of U.S. households have two or more PCs, indicating potential for maximizing computing power.