GStars
    EricLBuehler

    EricLBuehler/mistral.rs

    Fast, flexible LLM inference

    llm
    rust
    uqff
    Rust
    MIT
    7.8K stars
    762 forks
    47 GitHub watchers
    Updated Nov 6, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    5 releases in the last 90 days, the latest 18 days ago, with 101 contributors on GitHub.

    Peaked at #49 in the weekly ranking the week of Jun 28, its best in the past year.

    Use Cases & Benefits

    • Provides fast, flexible inference for large language models (LLMs) supporting text, vision, speech, and embeddings.
    • Enables zero-configuration use of any HuggingFace model with hardware-aware tuning and full quantization control for optimal performance.
    • Use for quickly deploying and interacting with HuggingFace LLMs via CLI or web UI without model conversion.
    • Use for integrating multimodal AI capabilities like vision and speech generation into Rust or Python applications using SDKs.
    • Use for benchmarking and optimizing LLM inference performance on custom hardware setups with automatic tuning and quantization.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    MIT

    Permissive: commercial use, modification and redistribution are allowed with attribution.

    Community files

    • README: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Fast, flexible LLM inference.

    Excerpt from the EricLBuehler/mistral.rs README on GitHub (MIT license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Sep 20: +5Sep 23: +1Sep 24: -1Sep 25: +0

    +208 stars over 81 days across 11 snapshot days; best day +5 on Sep 20.

    Forks

    762+82

    Open issues

    420+38

    Compared with peers in LLM

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth

    View category →
    EricLBuehler/mistral.rs compared with LLM repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    NVIDIA/auto-ontology11.4K+8.5K75—
    thedotmack/claude-mem115.8K+4.7K75today
    DietrichGebert/ponytail188.4K+4.4K7512 days ago
    affaan-m/ECC300.8K+4.3K7540 days ago
    Graphify-Labs/graphify145.7K+3.8K75today
    EricLBuehler/mistral.rs7.8K—5418 days ago
    Category median145.7K+4.4K75—
    Compare mistral.rs with auto-ontology, claude-mem, ponytail →

    Discover Repositories

    Search across tracked repositories by name or description