theagentrouter

    theagentrouter/agent-router

    Manages Unified Access to Generative AI Services built on Envoy Gateway

    ai
    api
    kubernetes
    llm
    ai-gateway
    api-gateway
    envoy
    envoyproxy
    inference
    Go
    Apache-2.0
    2.3K stars
    451 forks
    2.3K GitHub watchers
    Updated Nov 4, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    5 releases in the last 90 days, the latest 7 days ago, with 163 contributors on GitHub.

    Peaked at #50 in the weekly ranking the week of Sep 13, its best in the past year.

    Use Cases & Benefits

    • Manages unified access and routing for generative AI services using a two-tier Envoy Gateway architecture.
    • Enables centralized authentication, global rate limiting, and fine-grained control over self-hosted AI model inference endpoints.
    • Use for integrating multiple AI providers like OpenAI, Google Gemini, and AWS Bedrock into a single gateway interface.
    • Use for optimizing large language model inference traffic with endpoint selection in Kubernetes environments.
    • Use for securing and scaling generative AI service access in cloud native infrastructures with CNCF-compliant tooling.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Apache 2.0

    Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

    When using Envoy AI Gateway, we refer to a two-tier gateway pattern. The Tier One Gateway functions as a centralized entry point, and the Tier Two Gateway handles ingress traffic to a self-hosted model serving cluster.

    Excerpt from the theagentrouter/agent-router README on GitHub (Apache-2.0 license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Sep 7: +0Sep 11: +14Sep 12: +7Sep 13: +2Sep 14: +12Sep 15: +18Sep 18: +5Sep 19: +3Sep 20: +0Sep 21: +2Sep 24: +1Sep 28: +1Oct 8: +6Oct 9: +3

    +441 stars over 90 days across 24 snapshot days; best day +18 on Sep 15.

    Forks

    451+127

    Open issues

    431+187

    Compared with peers in AI

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth

    theagentrouter/agent-router compared with AI repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    thedotmack/claude-mem113.6K+8.8K35today
    D4Vinci/Scrapling98.1K+6.9K651 day ago
    Leonxlnx/taste-skill110.7K+5.2K551 day ago
    calesthio/OpenMontage77.2K+4.2K40—
    heygen-com/hyperframes79.6K+4.1K45today
    theagentrouter/agent-router2.3K—657 days ago
    Category median98.1K+5.2K45—

    Discover Repositories

    Search across tracked repositories by name or description