lmms-eval
by EvolvingLMMs-Lab · GitHub
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
⭐ Stars
4.3k
🍴 Forks
624
🔥 Trending
+17 this week
📜 License
—
License not specified📅 Created
2024
🔄 Last commit
today
🏷️ Category
agi
💻 Language
You maintain this project?
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
📈 Star history
2026-07-072026-07-22
📄 About
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
❓ Frequently asked questions
What is lmms-eval?
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Is lmms-eval open source?
lmms-eval is an open-source project.
Is lmms-eval free?
Yes. lmms-eval is free and open source — you can use, modify and self-host it.
🏅 Maintainer of this project?
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/evolvinglmms-lab-lmms-eval.html)
🧬 Related projects🧬 View the DNA map →
screenpipe
YC (S26) | Record your screen 24/7 and plug into your agents. Local, private, secure. Connect t…
★ 20.4k · agents
SuperAGI
<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to b…
★ 17.6k · agents
casdoor
An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and au…
★ 14k · agent