petals
by bigscience-workshop · GitHub
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
⭐ Stars
10.3k
🍴 Forks
627
🔥 Trending
+62 this week
📜 License
MIT
Commercial use OK📅 Created
2022
🔄 Last commit
1 yr ago
🏷️ Category
bloom
💻 Language
You maintain this project?
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
📈 Star history
2026-07-042026-07-22
📄 About
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
❓ Frequently asked questions
What is petals?
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Is petals open source?
petals is an open-source project. It is released under the MIT license.
Is petals free?
Yes. petals is free and open source — you can use, modify and self-host it.
🏅 Maintainer of this project?
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/bigscience-workshop-petals.html)
🧬 Shares DNA with🧬 View the DNA map →
chat.petals.dev
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
★ 320 · api
sharesbloomdistributed-systems
go-micro
A Go agent harness and service framework
★ 23k · ai
sharesdistributed-systems
BELLE
BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
★ 8.3k · bloom
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.