AI & LLM Tools
Run language models and AI apps locally — inference runners, chat UIs and local-first AI tooling.
20 apps
Ranking
Best Open-Source AI & LLM Tools
ollama
ollama
Ollama provides access to a variety of AI and large language models, including Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, and Gemma. It simplifies the process of setting up and using these models for various applications.
dify
langgenius
Dify is a production-ready platform for developing agentic workflows. It supports AI and LLM tools for streamlined workflow creation.
anything-llm
Mintplex-Labs
AnythingLLM is a local-first AI tool for running language models independently. It provides a self-hosted alternative to cloud-based solutions for users seeking full control over their AI agents.
daily_stock_analysis
ZhuLinsen
This AI-powered tool analyzes stocks across multiple markets using multi-source data, real-time news, and provides decision dashboards with automated alerts. It supports scheduled runs at no additional cost.
LocalAI
mudler
LocalAI is an open-source AI engine that supports various models, including LLMs, vision, voice, image, and video processing. It runs on any hardware without requiring a GPU.
milvus
milvus-io
Milvus is a cloud-native vector database designed for high-performance approximate nearest neighbor search. It supports scalable vector similarity search and management.
jan
janhq
Jan is an open-source AI tool that functions as a local alternative to ChatGPT. It operates entirely offline on personal computers without requiring cloud connectivity.
prompt-optimizer
linshenkx
This tool optimizes AI prompts to improve output quality from language models. It helps users refine their input for more effective AI interactions.
onyx
onyx-dot-app
Onyx is an open-source AI platform for chat applications with advanced features. It supports integration with various large language models.
llmfit
AlexsJones
This tool searches hundreds of AI models and providers to identify options compatible with your hardware specifications. It simplifies model selection through a single command interface.
composio
ComposioHQ
Composio provides toolkits, search, and context management for building AI agents. It includes authentication and a sandboxed workbench to convert user intent into automated actions. The platform supports over 1000 integrated tools.
llamafile
mozilla-ai
Llamafile simplifies LLM distribution by packaging models into a single executable file. It enables running large language models without complex setup or dependencies.
algernon
xyproto
Algernon is a lightweight web server written in Go that supports multiple scripting languages including Lua and Teal. It includes built-in support for Markdown rendering, Ollama integration, and database connectivity with SQLite and PostgreSQL. The server features modern protocols like HTTP/2 and QUIC, along with Redis caching capabilities.
TranslateBooksWithLLMs
hydropix
TranslateBooksWithLLMs translates entire books and documents using multiple AI models, including Ollama, OpenAI, Gemini, Mistral, Poe, and OpenRouter. It maintains formatting, allows resuming from previous progress, and supports files of any size.
row-bot
siddsachar
Row-Bot is a local-first AI assistant that runs primarily on-device, supporting voice, vision, and task automation while keeping user data private. It integrates tools for knowledge management, health tracking, and messaging, with optional cloud model support via Ollama. The system prioritizes user sovereignty by defaulting to local processing.
PhoneClaw
kellyvv
PhoneClaw is a mobile-native AI framework designed for phones and edge devices, featuring an iOS runtime and fully offline local operation. It supports on-device models, native iOS Skills, and optional Mac Gateway inference for enhanced functionality.
Atomic-Chat
AtomicBot-ai
Atomic-Chat is a local AI application and inference engine designed to run open-weight large language models entirely offline on personal computers. It ensures privacy by operating without requiring an internet connection.
PokeClaw
agents-io
PokeClaw is an on-device AI tool for Android that controls your phone without cloud services or API keys. It uses Gemma 4 technology to operate locally on your device.
locally-uncensored
PurpleDoubleD
Local AI desktop app for uncensored chat, agent mode, and image/video generation. Runs offline with supported LLMs and ComfyUI via a single executable, no Docker required. Supports custom providers.
NornicDB
orneryd
NornicDB is a distributed database combining graph and vector capabilities with temporal MVCC support. It offers sub-millisecond HNSW search, graph traversal, and write operations while maintaining compatibility with Neo4j Bolt/Cypher and Qdrant's gRPC protocols. The system includes features like schema management, embedding automation, GPU acceleration, and policy-based memory optimization.