local-llm

50 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory,…

Distribute and run LLMs with a single file.

local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google,…

open-multi-agent

TypeScript AI agent orchestration framework with dynamic workflows. Describe the goal, not the graph: a…

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware…

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to…

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+…

Harness LLMs with Multi-Agent Programming

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open…

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling.…

awesome-local-llm

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

TranslateBooksWithLLMs

Translate full-length books and documents with Ollama, OpenAI (comptatible), Gemini, Mistral, Poe or…

openai-edge-tts

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs entirely…

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR…

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs…

awesome-openclaw

A curated list of OpenClaw resources, tools, skills, tutorials & articles. OpenClaw (formerly Moltbot /…

locally-uncensored

Plug-and-play local AI studio: uncensored chat, image & video generation, coding agent. Runs abliterated LLMs…

agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with one…

🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app…

Nornicdb is a distributed low-latency, Graph+Vector, Temporal MVCC with all sub-ms HNSW search, graph…

Autonomous AI pentesting engine, continuous offensive security across web, cloud, AD & Kubernetes. Agentic…

The most advanced, fully offline client-side AI suite on Android today.

Open-source local-first AI agent for desktop work. No account, no telemetry: use local models with…

chatterbox-tts-api

Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned…

a magical LLM desktop client that makes it easy for *anyone* to use LLMs and MCP

Run AI ✨ assistant locally! with simple API for Node.js 🚀

A simple "Be My Eyes" web app with a llama.cpp/llava backend

AI-powered IDE for novel writing — local LLM + RAG, privacy-first, BYOK. For web fiction authors and…

awesome-second-brain

A curated solutions to building a self-evolving second brain that helps AI agents understand your personal…

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default,…

Local-first AI-powered document intelligence platform for investigative journalism

Stop degrading your model's reasoning. A minimal, zero-config AI coding agent. Enforced ephemeral subagents…

Local coding agent with neat UI

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX…

local-llms-on-android

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question…

Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of…

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD.…

Open-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via…

sndr_core_engine

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere…

Enterprise-ready self-hosted AI assistant runtime with sandboxed execution, secure credentials, approvals,…

Local-first desktop AI workbench for roleplay, multi-character chat, long-form writing, RAG, MCP tools,…

Selfhost modern LLM stacks. Run the whole fleet from your terminal

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

★ 80 · GitHub ↗

Native AI inference for PHP 8.3+ - run ONNX, GGUF (llama.cpp) and RubixML models directly in your PHP process…

★ 56 · GitHub ↗

dgx-spark-inference-stack

Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your…

★ 50 · GitHub ↗

Bounded, inspectable LLM inference pipelines from declared YAML — runs offline against Ollama or any…

★ 45 · GitHub ↗

🔗 Related families

gguf 26 local-ai 36 apple-silicon 32 mlx 36 llama-cpp 28 inference 94 qwen 102 desktop-app 65

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.