vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations 🚀
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
No releases in the last 90 days; the most recent was 294 days ago, with 240 contributors on GitHub.
Gained 20% fewer stars in the last 90 days than in the 90 days before.
Use Cases & Benefits
- Provides a toolkit to evaluate and optimize Large Language Model (LLM) applications using objective metrics and automated test data generation.
- Enables data-driven, efficient, and production-aligned evaluation workflows that reduce subjective and time-consuming assessments.
- Use for generating comprehensive test datasets automatically when no test data is available for LLM applications.
- Use for integrating with popular LLM frameworks like LangChain to seamlessly evaluate and benchmark LLM performance.
- Use for building continuous feedback loops leveraging production data to iteratively improve LLM application accuracy and reliability.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
- Code of conduct: present
Watch-outs
- No commits in the last six months (last push Feb 2026).
General guidance from repository metadata, not legal advice. How we score
From the README
Supercharge Your LLM Application Evaluations 🚀
Objective metrics, intelligent test generation, and data-driven insights for LLM apps
Ragas is your ultimate toolkit for evaluating and optimizing Large Language Model (LLM) applications. Say goodbye to time-consuming, subjective assessments and hello to data-driven, efficient evaluation workflows. Don't have a test dataset ready? We also do production-aligned test set generation.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
1.8K+163
Open issues
649+89
Compared with peers in LLM
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| NVIDIA/auto-ontology | 11.4K | +8.5K | 75 | — |
| thedotmack/claude-mem | 115.8K | +4.7K | 75 | today |
| DietrichGebert/ponytail | 188.4K | +4.4K | 75 | 12 days ago |
| affaan-m/ECC | 300.8K | +4.3K | 75 | 40 days ago |
| Graphify-Labs/graphify | 145.7K | +3.8K | 75 | today |
| vibrantlabsai/ragas | 16.2K | — | 49 | 294 days ago |
| Category median | 145.7K | +4.4K | 75 | — |
Discover Repositories
Search across tracked repositories by name or description