microsoft

    microsoft/foundry-local

    web
    ai-sdk
    chat-completions
    foundry-local
    gpu-acceleration
    local-ai
    C++
    NOASSERTION
    2.6K stars
    383 forks
    2.6K GitHub watchers
    Updated Nov 2, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    5 releases in the last 90 days, the latest today, with 42 contributors on GitHub.

    Gained 47% fewer stars in the last 90 days than in the 90 days before.

    Use Cases & Benefits

    • Runs generative AI models locally on your device without requiring an Azure subscription or cloud connectivity.
    • Enables private, low-latency AI inference with hardware-optimized performance using ONNX Runtime and GPU/NPU acceleration.
    • Use for integrating AI chat completions and speech-to-text features in applications while keeping data fully on-device.
    • Use for prototyping and testing AI models locally before deploying to cloud or edge environments.
    • Use for deploying AI workloads in edge computing scenarios with limited or no internet connectivity.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Other

    GitHub could not identify this license; read the LICENSE file before depending on it.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    • License not identified by GitHub; read the LICENSE file before depending on it.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    You can list all available models by running the following command:

    This will show you a list of all models that can be run locally, including their names, sizes, and other details.

    Excerpt from the microsoft/foundry-local README on GitHub (NOASSERTION license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Forks

    383+22

    Open issues

    113+47

    Compared with peers in Web

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth

    microsoft/foundry-local compared with Web repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    pingdotgg/t3code48.4K+16.6K40today
    pbakaus/impeccable104.0K+8.7K5410 days ago
    HunYiSage/dsh-purge19.2K+6.2K13today
    Renhuai123/ziwei-doushu16.2K+6.1K4421 days ago
    paperclipai/paperclip111.5K+2.8K5913 days ago
    microsoft/foundry-local2.6K—45today
    Category median48.4K+6.2K44—

    Also by microsoft

    Other repositories from this maintainer that GStars tracks

    Discover Repositories

    Search across tracked repositories by name or description