evaluation-metrics
12 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
deepeval
The LLM Evaluation Framework
★ 17.3k
agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and…
★ 5.7k
tiny-universe
《大模型白盒子构建指南》：一个全手搓的Tiny-Universe
★ 5k
evaluation-guidebook
Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while…
★ 2.1k
AB3DMOT
(IROS 2020, ECCVW 2020) Official Python Implementation for "3D Multi-Object Tracking: A Baseline and New…
★ 1.8k
continuous-eval
Data-Driven Evaluation for LLM-Powered Applications
★ 515
Cloud_Map_Evaluation
[RAL' 25 & IROS‘ 25] MapEval: Towards Unified, Robust and Efficient SLAM Map Evaluation Framework.
★ 481
Awesome-Evaluation-of-Visual-Generation
A list of works on evaluation of visual generation models, including evaluation metrics, models, and systems
★ 454
DreamLayer
Benchmark diffusion models faster. Automate evals, seeds, and metrics for reproducible results.
★ 411
open-rag-eval
RAG evaluation without the need for "golden answers"
★ 385
tonic_validate
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
★ 327
athina-evals
Python SDK for running evaluations on LLM generated responses
★ 301
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.