LocalAI
About LocalAI
LocalAI is an open-source AI engine designed to run various AI models locally on any hardware, including CPUs and GPUs. It supports multiple modalities such as text generation, vision, voice, image, and video processing. The engine is modular, allowing users to install only the necessary components for their specific model requirements.
LocalAI provides API compatibility with popular services like OpenAI, Anthropic, and ElevenLabs, making it easier to integrate into existing workflows. It is designed to be privacy-first, ensuring that all data remains on the user's infrastructure. The engine supports multi-user environments with features like API key authentication, user quotas, and role-based access control.
Key features
- Composable by design with separate backends pulled on demand
- Open and extensible, allowing any model to be loaded or custom backends to be built
- Drop-in API compatibility with OpenAI, Anthropic, and ElevenLabs
- Supports multiple modalities including LLMs, vision, voice, image, and video
- Runs on any hardware including NVIDIA, AMD, Intel, Apple Silicon, Vulkan, or CPU-only
- Multi-user ready with API key auth, user quotas, and role-based access
- Built-in AI agents with tool use, RAG, MCP, and skills
- Privacy-first design ensuring data never leaves your infrastructure
Download v4.6.2
Jul 6, 2026macOSmacOS
Frequently asked questions
- Is LocalAI free?
- Yes. LocalAI is free and open-source software, distributed under the MIT license.
- Which platforms does LocalAI support?
- LocalAI provides downloads for macOS.
- What is the latest version of LocalAI?
- The latest version is v4.6.2, released on Jul 6, 2026.
- What is LocalAI?
- LocalAI is an open-source AI engine that allows users to run various AI models locally on any hardware, including CPUs and GPUs, without requiring cloud services.
- How do I install LocalAI?
- LocalAI can be installed via Docker containers for different hardware configurations, including CPU-only, NVIDIA GPU, AMD GPU, Intel GPU, and Vulkan GPU. There is also a macOS download available.
- What platforms does LocalAI support?
- LocalAI supports a wide range of hardware platforms, including NVIDIA, AMD, Intel, Apple Silicon, Vulkan, and CPU-only systems.
- What is the license for LocalAI?
- LocalAI is licensed under the MIT License.
More AI & LLM Tools
ollama
ollama
Ollama provides access to a variety of AI and large language models, including Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It simplifies the process of setting up and using these models for various applications.
dify
langgenius
Dify is a production-ready platform for developing agentic workflows. It supports AI and LLM tools for streamlined workflow creation.
anything-llm
Mintplex-Labs
AnythingLLM is a local-first AI tool for running language models independently. It provides a self-hosted alternative to cloud-based solutions for users seeking full control over their AI agents.