Text Generation WebUI (oobabooga) is a comprehensive Gradio web interface for running local models across many backends and formats, with extensions and fine-tuning hooks.
| Category | Run LLMs locally |
| Type | Web UI |
| License | AGPL-3.0 |
| Runs locally | Yes |
| Built with | Python |
| Skill level | Intermediate |
| Best for | power users who want maximum knobs and formats |
Other open-source run llms locally tools worth comparing:
OllamaRun open LLMs locally from one command
JanOpen-source, offline ChatGPT-style desktop app
GPT4AllPrivate local AI that runs on CPU
llama.cppThe C/C++ engine powering local inference
LocalAIA drop-in OpenAI API you self-host
KoboldCppSingle-file local model runner
MLC LLMRun LLMs on any device, even phones
llamafileOne executable file = model + runtime
exoRun big models across your everyday devices
CortexOllama-style runtime from the Jan team
Nexa SDKRun any model on any device — CPU, GPU, NPU
RamaLamaRun models as OCI containers
GPUStackManage GPU clusters for running modelsText Generation WebUI is free and open-source (AGPL-3.0 license), so you can use, self-host and modify it at no cost.
Yes. Text Generation WebUI is designed to run on your own machine or server, keeping your data private.
Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.
Browse the full directory of open-source AI tools, models and projects — updated daily.
Browse all tools →