comet-ml

    comet-ml/opik

    #378 this week

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    llm
    ai
    evaluation
    hacktoberfest
    hacktoberfest2025
    langchain
    llama-index
    Python
    Apache-2.0
    22.8K stars
    1.9K forks
    22.8K GitHub watchers
    Updated Oct 20, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    Ranks #378 of 3,103 repositories GStars tracks this week (top 12%).

    5 releases in the last 90 days, the latest today, with 167 contributors on GitHub.

    Gained 11% more stars in the last 90 days than in the 90 days before.

    Use Cases & Benefits

    • Provides an open-source platform to debug, evaluate, monitor, and optimize large language model (LLM) applications and agentic workflows with tracing and dashboards.
    • Offers comprehensive observability, automated evaluations, and production-ready monitoring with integrations for many popular LLM frameworks and scalable trace logging.
    • Use for developing and debugging RAG chatbots and conversational AI with detailed trace logging and prompt experimentation.
    • Use for automating LLM evaluation and testing in CI/CD pipelines using LLM-as-a-judge metrics for hallucination detection and moderation.
    • Use for production monitoring and optimization of LLM-powered systems with real-time dashboards, online evaluation rules, and agent optimization features.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Apache 2.0

    Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.

    Community files

    • README: present
    • Contributing guide: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Opik helps you build, evaluate, and optimize LLM systems that run better, faster, and cheaper. From RAG chatbots to code assistants to complex agentic pipelines, Opik provides comprehensive tracing, evaluations, dashboards, and powerful features like Opik Agent Optimizer and Opik Guardrails to improve and secure your LLM powered applications in production.

    Excerpt from the comet-ml/opik README on GitHub (Apache-2.0 license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Aug 4: +14

    +1,952 stars over 89 days across 8 snapshot days; best day +14 on Aug 4.

    Forks

    1.9K+248

    Open issues

    191+36

    Compared with peers in LLM

    Fastest-growing repositories GStars tracks in this cohort for the week of Oct 18, by 7-day star growth

    comet-ml/opik compared with LLM repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    DietrichGebert/ponytail174.8K+9.9K757 days ago
    xerj-org/xerj14.2K+7.8K75today
    affaan-m/ECC287.3K+6.4K6422 days ago
    tashfeenahmed/freellmapi40.3K+4.1K75today
    JuliusBrussee/caveman114.4K+2.2K759 days ago
    comet-ml/opik22.8K+075today
    Category median114.4K+6.4K75—

    Discover Repositories

    Search across tracked repositories by name or description