Foundry Local

Microsoft Corporation · Microsoft.FoundryLocal

Foundry Local enables local execution of Small Language Models using the hardware on your device.

Foundry Local brings the power of Azure AI Foundry to your local device. It allows you to run large language models (LLMs) directly on your hardware and keep all data processing on device for enhanced privacy and security. It also has an OpenAI compatible API and hardware acceleration out of the box, ensuring you're getting a simple and performant experience regardless of what hardware you are using.