Microsoft brings OpenAI’s smallest open model to Windows users

Microsoft has announced the integration of OpenAI’s latest free and open GPT model, gpt-oss-20b, into its Windows AI Foundry platform. This initiative allows Windows 11 users to leverage advanced AI capabilities, APIs, and popular open-source models directly from their desktops.

Optimized for Efficiency

In a recent blog post, Microsoft described gpt-oss-20b as “tool-savvy and lightweight.” The model is specifically optimized for agentic tasks, such as code execution and tool utilization, ensuring it operates smoothly across a variety of Windows hardware configurations. The company anticipates expanding support to additional devices in the near future. This model is particularly suited for developing autonomous assistants and integrating AI into practical workflows, even in environments with limited bandwidth.

Launched on Tuesday, gpt-oss-20b is compatible with consumer PCs and laptops equipped with a minimum of 16GB of VRAM, a specification met by many modern GPUs from Nvidia and Radeon. OpenAI has trained this model using high-compute reinforcement learning techniques, enhancing its ability to power AI agents and execute tasks like web searches or Python code execution as part of its chain-of-thought reasoning.

Limitations and Future Prospects

Despite its advanced capabilities, gpt-oss-20b is a text-only model, which means it lacks the ability to process or generate images and audio, unlike some of OpenAI’s other offerings. Additionally, it has demonstrated a tendency to hallucinate, with a reported 53% hallucination rate in response to questions on PersonQA, OpenAI’s internal benchmark for assessing knowledge accuracy about individuals.

Looking ahead, Microsoft plans to extend the availability of gpt-oss-20b to macOS and other unspecified devices. Furthermore, both gpt-oss-20b and its predecessor, gpt-oss-120b, will be accessible through Microsoft’s hosted Azure AI Foundry platform. In a bid to broaden its reach, these models are also set to be available on Amazon’s AWS, enhancing the accessibility of advanced AI tools for developers and businesses alike.

Winsage
Microsoft brings OpenAI's smallest open model to Windows users