LocalAI

The free, OpenAI, Anthropic alternative. Your All-in-One Complete AI Stack - Run powerful language models, autonomous agents, and document intelligence locally on your hardware.

No cloud, no limits, no compromise.

Tip

⭐ Star us on GitHub - 33.3k+ stars and growing!

Drop-in replacement for OpenAI API - modular suite of tools that work seamlessly together or independently.

Start with LocalAI’s OpenAI-compatible API, extend with LocalAGI’s autonomous agents, and enhance with LocalRecall’s semantic search - all running locally on your hardware.

Open Source MIT Licensed.

Why Choose LocalAI?

OpenAI API Compatible - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud.

Key Features

  • LLM Inferencing: LocalAI is a free, Open Source OpenAI alternative. Run LLMs, generate images, audio and more locally with consumer grade hardware.
  • Agentic-first: Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. Build and deploy autonomous agents with ease.
  • Memory and Knowledge base: Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications.
  • OpenAI Compatible: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries.
  • No GPU Required: Run on consumer grade hardware. No need for expensive GPUs or cloud services.
  • Multiple Models: Support for various model families including LLMs, image generation, and audio models. Supports multiple backends for inferencing.
  • Privacy Focused: Keep your data local. No data leaves your machine, ensuring complete privacy.
  • Easy Setup: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation.
  • Community Driven: Active community support and regular updates. Contribute and help shape the future of LocalAI.

Quick Start

Docker is the recommended installation method for most users:

docker run -p 8080:8080 --name local-ai -ti localai/localai:latest

For complete installation instructions, see the Installation guide.

Get Started

  1. Install LocalAI - Choose your installation method (Docker recommended)
  2. Quickstart Guide - Get started quickly after installation
  3. Install and Run Models - Learn how to work with AI models
  4. Try It Out - Explore examples and use cases

Learn More