localllama

5 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

llama-swap

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

★ 5.2k

OllamaSharp

The easiest way to use Ollama in .NET

★ 1.4k

kubectl-ai

✨ Kubectl plugin to create manifests with LLMs

★ 1.2k

aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

★ 533

KVQuant

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

★ 430

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.