ai-dynamo/aiperf
AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
1 release in the last 90 days, the latest 43 days ago, with 104 contributors on GitHub.
Use Cases & Benefits
- Measures and benchmarks the performance of generative AI models across various inference solutions with detailed metrics and reports.
- Offers a scalable multiprocess architecture with extensible plugins and multiple UI modes for flexible, real-time, and comprehensive benchmarking.
- Use for evaluating latency and throughput of local or remote generative AI model endpoints under different concurrency and request-rate scenarios.
- Use for replaying real-world production traffic traces to simulate and analyze AI model performance in realistic workloads.
- Use for integrating with telemetry platforms like MLflow, OpenTelemetry, and Weights & Biases to monitor and visualize AI inference metrics continuously.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution. It provides detailed metrics using a command line display as well as extensive benchmark performance reports.
This quick start guide leverages Ollama via Docker Desktop.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
+269 stars over 72 days across 7 snapshot days; best day +9 on Aug 27.
Forks
257+99
Open issues
130+38
Compared with peers in Backend
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| anthropics/skills | 187.8K | +2.9K | 15 | — |
| DuarteSantos8/openGym | 19.7K | +2.4K | 60 | 2 days ago |
| shiyu-coder/Kronos | 47.0K | +2.3K | 16 | — |
| NationalSecurityAgency/ghidra | 98.2K | +2.3K | 64 | 14 days ago |
| microsoft/VibeVoice | 56.0K | +1.1K | 29 | — |
| ai-dynamo/aiperf | 855 | — | 58 | 43 days ago |
| Category median | 56.0K | +2.3K | 29 | — |
Also by ai-dynamo
Other repositories from this maintainer that GStars tracks
Discover Repositories
Search across tracked repositories by name or description