Features

LocalAI provides a comprehensive set of features for running AI models locally. This section covers all the capabilities and functionalities available in LocalAI.

Core Features

• Text Generation - Generate text with GPT-compatible models using various backends
• Image Generation - Create images with Stable Diffusion and other diffusion models
• Audio Processing - Transcribe audio to text and generate speech from text
• Embeddings - Generate vector embeddings for semantic search and RAG applications
• GPT Vision - Analyze and understand images with vision-language models

Advanced Features

• OpenAI Functions - Use function calling and tools API with local models
• Constrained Grammars - Control model output format with BNF grammars
• GPU Acceleration - Optimize performance with GPU support
• Distributed Inference - Scale inference across multiple nodes
• Model Context Protocol (MCP) - Enable agentic capabilities with MCP integration

Specialized Features

• Object Detection - Detect and locate objects in images
• Reranker - Improve retrieval accuracy with cross-encoder models
• Stores - Vector similarity search for embeddings
• Model Gallery - Browse and install pre-configured models
• Backends - Learn about available backends and how to manage them

Getting Started

To start using these features, make sure you have LocalAI installed and have downloaded some models. Then explore the feature pages above to learn how to use each capability.