blackwell

6 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a high-performance serving framework for large language models and multimodal models.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and…

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

TokenSpeed is a speed-of-light LLM inference engine.

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

🔗 Related families

qwen 102 cuda 90 gpt-oss 14 kimi 23 llm-serving 23 moe 11 glm 23 minimax 15

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.