Best Open-Source AI & LLM Tools
Top open-source tools to run large language models and AI apps locally, ranked by GitHub stars with direct downloads.
| # | App | Stars | License |
|---|---|---|---|
| 1 | ollama | 175.9k | MIT |
| 2 | dify | 148.5k | NOASSERTION |
| 3 | anything-llm | 63.1k | MIT |
| 4 | daily_stock_analysis | 56.7k | MIT |
| 5 | LocalAI | 47.5k | MIT |
| 6 | milvus | 45.2k | Apache-2.0 |
| 7 | jan | 43.5k | NOASSERTION |
| 8 | prompt-optimizer | 32.0k | NOASSERTION |
| 9 | onyx | 30.8k | NOASSERTION |
| 10 | llmfit | 29.3k | MIT |
Ollama provides access to a variety of AI and large language models, including Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It simplifies the process of setting up and using these models for various applications.
Dify is a production-ready platform for developing agentic workflows. It supports AI and LLM tools for streamlined workflow creation.
AnythingLLM is a local-first AI tool for running language models independently. It provides a self-hosted alternative to cloud-based solutions for users seeking full control over their AI agents.
This AI-powered tool analyzes stocks across multiple markets using multi-source data, real-time news, and provides decision dashboards with automated alerts. It supports scheduled runs at no additional cost.
LocalAI is an open-source AI engine that supports various models, including LLMs, vision, voice, image, and video processing. It runs on any hardware without requiring a GPU.
Milvus is a cloud-native vector database designed for high-performance approximate nearest neighbor search. It supports scalable vector similarity search and management.
Jan is an open-source AI tool that functions as a local alternative to ChatGPT. It operates entirely offline on personal computers without requiring cloud connectivity.
This tool optimizes AI prompts to improve output quality from language models. It helps users refine their input for more effective AI interactions.
Onyx is an open-source AI platform for chat applications with advanced features. It supports integration with various large language models.
This tool searches hundreds of AI models and providers to identify options compatible with your hardware specifications. It simplifies model selection through a single command interface.
Frequently asked questions
- What is the top pick in “Best Open-Source AI & LLM Tools”?
- ollama currently leads this list, which is ordered by GitHub stars among the 10 open-source options we track.
- Are these apps free?
- Yes. Every app on this list is free and open-source. Download links point to each project's official release.
- How is this ranking decided?
- The order reflects GitHub stars, a public measure of popularity. Data is pulled from official sources and last refreshed on a recent run. We don't accept payment for placement.
How we rank:entries are ordered by GitHub stars, a public popularity signal. Versions, licenses and platform support are read from official release feeds. We don't accept payment for inclusion or position. Supported platforms reflect the latest release (macOS, Windows, Linux).