Windows 11’s sneaky new AI tool is a game-changer

Microsoft recently introduced Foundry AI Local at its Build conference, a command-line tool designed to run large language models (LLMs) directly on users’ machines. While initially aimed at developers, its user-friendly interface makes it an appealing option for anyone interested in exploring local AI capabilities.

Streamlined Installation Process

One of the standout features of Windows is its “winget” tool, which simplifies application installation akin to a food delivery service. Instead of navigating through websites or the Microsoft Store, users can simply open a command line and request their desired applications. Foundry AI Local operates on this same principle, allowing users to install it with minimal effort.

To get started with Foundry AI Local, users need to follow these straightforward steps:

Open a command-line terminal by typing the Windows key and searching for “terminal” or “Windows PowerShell.”
At the prompt, enter the command:
```
winget install Microsoft.FoundryLocal
```
and wait for the necessary files to download.
To run the Phi-3.5-mini model, type:
```
foundry model run phi-3.5-mini
```
and follow the prompts.
Explore other available models by entering:
```
foundry model list
```
and substitute the model name as needed.

This simplicity is complemented by the tool’s efficiency; it automatically selects the best model for the user’s hardware configuration, enhancing performance without requiring extensive technical knowledge.

Potential Beyond Chatbots

While Foundry AI Local currently serves as a local chatbot, its potential applications extend beyond simple text generation. Developers can adapt and convert various models to run locally, potentially integrating advanced functionalities like text extraction tools into existing Windows applications.

Despite its current limitations compared to cloud-based services such as ChatGPT or Gemini, Foundry AI Local’s ease of use and seamless integration into Windows could pave the way for further enhancements in the future. As Microsoft continues to develop this tool, possibilities such as art generation or custom model training may soon be on the horizon.

In a landscape where local AI applications are gaining traction, Foundry AI Local stands out as a promising entry point for users eager to explore the capabilities of AI on their own devices.

Winsage