GStars
    NVIDIA-NeMo

    NVIDIA-NeMo/Switchyard

    #264 this week

    Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

    backend
    Rust
    Apache-2.0
    3.4K stars
    338 forks
    3.4K GitHub watchers
    Updated Oct 22, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    Ranks #264 of 3,103 repositories GStars tracks this week (top 9%).

    2 releases in the last 90 days, the latest 29 days ago, with 64 contributors on GitHub.

    Peaked at #72 in the weekly ranking the week of Aug 9, its best in the past year.

    Use Cases & Benefits

    • Routes and translates LLM API requests across multiple providers while preserving native OpenAI and Anthropic API compatibility.
    • Enables flexible multi-backend routing and benchmarking with typed, composable algorithms and operational metrics for cost and performance optimization.
    • Use for integrating diverse LLM providers into a single proxy while maintaining client API consistency in Rust applications.
    • Use for A/B testing and cost experiments by splitting traffic across different LLM models with customizable routing strategies.
    • Use for embedding advanced routing algorithms in custom Rust-based LLM agents or gateways without managing HTTP stacks.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Apache 2.0

    Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Switchyard is a Rust proxy and library for LLM traffic. It routes requests across providers, translates between OpenAI and Anthropic APIs, records operational metrics, and provides typed, composable routing algorithms.

    Why Switchyard? Point a coding agent such as Claude Code or Codex at an open-source model. Switchyard translates between the OpenAI Chat, Anthropic Messages, and OpenAI Responses formats, so the agent keeps speaking its native API while the request is served by vLLM, NVIDIA NIM, Ollama, or any OpenAI-compatible endpoint. The same proxy can spread traffic across several models for A/B benchmarking, apply signal-driven stage routing, or run a custom algorithm you write yourself.

    Switchyard is pre-alpha software that is evolving rapidly. The API and algorithms are expected to change significantly before we reach v1.0.

    Excerpt from the NVIDIA-NeMo/Switchyard README on GitHub (Apache-2.0 license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Aug 13: +407Aug 14: +302Aug 15: +123Aug 16: +102Aug 17: +124Aug 18: +73Aug 19: +45Aug 20: +51Aug 27: +38Aug 28: +16Sep 11: +56Sep 12: +60Sep 13: +76Sep 14: +47Sep 15: +14Sep 16: +48Sep 17: +18Sep 18: +13Sep 19: +11Sep 20: +7

    +2,696 stars over 71 days across 25 snapshot days; best day +407 on Aug 13.

    Forks

    338+260

    Open issues

    132+50

    Compared with peers in Backend

    Fastest-growing repositories GStars tracks in this cohort for the week of Oct 18, by 7-day star growth

    View category →
    NVIDIA-NeMo/Switchyard compared with Backend repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    anthropics/claude-plugins-official44.4K+4.3K75—
    NationalSecurityAgency/ghidra94.0K+4.2K752 days ago
    akitaonrails/ai-memory13.3K+3.4K752 days ago
    K-Dense-AI/scientific-agent-skills54.2K+3.1K7522 days ago
    shiyu-coder/Kronos43.6K+2.7K75—
    NVIDIA-NeMo/Switchyard3.4K+07529 days ago
    Category median44.4K+3.4K75—
    Compare Switchyard with claude-plugins-official, ghidra, ai-memory →

    Also by NVIDIA-NeMo

    Other repositories from this maintainer that GStars tracks

    Discover Repositories

    Search across tracked repositories by name or description