🏠 Best Local and open-source models AI Tools

A self-hosted engine that runs text, image and voice AI models locally behind an OpenAI-compatible API

Free and open source; self-hosting, model or API costs may apply

Meta's open-weight Llama models you can download and run on your own hardware

Free open weights; license terms apply; hardware or hosting costs may apply

Microsoft's small language models built to run efficiently on-device

Free open weights; license terms apply; hardware or hosting costs may apply

Compile and run models natively on phones, browsers, and GPUs

Free and open source; self-hosting, model or API costs may apply

Desktop app for chatting with local and online models in one place

Free to use; paid licence options listed on msty.ai

Fair-code workflow automation with AI nodes

Self-host free option; cloud Starter about €20/mo billed annually; Pro about €50/mo billed annually; free trial available

Chat with your own files using a local model on an RTX PC

Free download; requires a supported NVIDIA RTX GPU

NVIDIA's open models, datasets, and recipes for building your own AI

Free open weights; license terms apply; hardware or hosting costs may apply

A simple app and command-line tool for downloading and running open AI models on your own computer

Free and open source; self-hosting, model or API costs may apply

A self-hosted AI chat and search platform that connects to your team's documents and apps

Free and open source (open-core: some features are paid); self-hosting, model or API costs may apply

Self-hosted ChatGPT-style interface for Ollama and other models

Free and open source; self-hosting, model or API costs may apply

A document manager that scans, OCRs and auto-tags your paperwork, with optional AI chat

Free and open source; self-hosting, model or API costs may apply

A private AI layer for asking questions about your documents with local models

Free and open source; self-hosting, model or API costs may apply

Alibaba's Qwen open-weight model family for text, code, and vision

Free open weights; license terms apply; hardware or hosting costs may apply

Popular open-source web UI for running local language models

Free and open source; self-hosting, model or API costs may apply

A desktop app that transcribes audio and video into text on your own computer

Free and open source; self-hosting, model or API costs may apply

High-throughput open-source engine for serving models on your own GPUs

Free and open source; self-hosting, model or API costs may apply