GStars
    tashfeenahmed

    tashfeenahmed/freellmapi

    #22 this week

    7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

    llm
    TypeScript
    MIT
    49.3K stars
    6.8K forks
    275 GitHub watchers
    Updated Nov 9, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    Ranks #2 among LLM repositories ranked this week, and #2 over the last 30 days; #22 of 170 repositories with measured growth this week (top 13%).

    This week's +3,549 stars is in line with its 30-day pace of about +3,833 per week.

    5 releases in the last 90 days, the latest today, with 118 contributors on GitHub.

    Peaked at #5 in the weekly ranking the week of Sep 20, its best in the past year.

    Use Cases & Benefits

    • Aggregates free tiers of 16+ large language model providers behind a single OpenAI-compatible API endpoint with smart routing and automatic failover.
    • Enables seamless, unified access to a vast combined free token quota (~1.7B tokens/month) with encrypted key storage and per-key rate tracking.
    • Use for personal experimentation with multiple LLMs without managing separate SDKs or rate limits for each provider.
    • Use for building type-safe, multi-provider chat applications that require fallback and sticky session support across diverse LLMs.
    • Use for integrating free-tier embeddings and media generation models into projects with a single unified API and live model catalog updates.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    MIT

    Permissive: commercial use, modification and redistribution are allowed with attribution.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    One OpenAI-compatible endpoint. Sixteen free LLM providers. ~1.7B tokens per month.

    Aggregate the free tiers from Google, Groq, Cerebras, NVIDIA, Mistral, OpenRouter, GitHub Models, Cohere, Cloudflare, HuggingFace, Z.ai (Zhipu), Ollama, Kilo, Pollinations, LLM7, OVH AI Endpoints, and OpenCode Zen — plus any custom OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, local Ollama) — behind a single /v1/chat/completions endpoint. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.

    freellmapi.co — browse the live model catalog

    Every serious AI lab now offers a free tier — a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly 1.7 billion tokens per month of working inference capacity, across 100+ models from small-and-fast to reasonably capable.

    The problem is that stacking them by hand is painful: seventeen different SDKs, seventeen different rate limits, seventeen places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for.

    Excerpt from the tashfeenahmed/freellmapi README on GitHub (MIT license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Aug 27: +413Aug 28: +538Aug 29: +581Aug 30: +471Aug 31: +666Sep 1: +270Sep 2: +294Sep 3: +231Sep 4: +191Sep 5: +136Sep 6: +173Sep 7: +200Sep 8: +260Sep 9: +164Sep 10: +150Sep 11: +171Sep 12: +213Sep 13: +219Sep 14: +200Sep 15: +246Sep 16: +246Sep 17: +238Sep 18: +237Sep 19: +259Sep 20: +239Sep 21: +211Sep 22: +205Sep 23: +238Sep 24: +182Sep 25: +276Sep 26: +267Sep 27: +220Sep 28: +210Oct 2: +202Oct 3: +230Oct 4: +217Oct 5: +306Oct 6: +316Oct 7: +346Oct 8: +513Oct 9: +400Oct 10: +396Oct 11: +392Oct 12: +211Oct 13: +662Oct 14: +602Oct 15: +594Oct 16: +474Oct 17: +445Oct 18: +410Oct 19: +450Oct 20: +577Oct 21: +667Oct 22: +630Oct 23: +637Oct 24: +673Oct 25: +703Oct 26: +614Oct 27: +591Oct 28: +558Oct 29: +648Oct 30: +644Oct 31: +646Nov 1: +519Nov 2: +531Nov 3: +670Nov 4: +648Nov 5: +514Nov 6: +468Nov 7: +456Nov 8: +377Nov 9: +416

    +30,234 stars over 81 days across 75 snapshot days; best day +703 on Oct 25.

    Forks

    6.8K+4.0K

    Open issues

    53-3

    Compared with peers in LLM

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth

    View category →
    tashfeenahmed/freellmapi compared with LLM repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    thedotmack/claude-mem114.9K+5.6K35today
    affaan-m/ECC299.7K+4.9K6338 days ago
    Graphify-Labs/graphify144.5K+4.0K651 day ago
    tashfeenahmed/freellmapi49.3K+3.5K45today
    HKUDS/DeepTutor57.0K+3.3K652 days ago
    blader/humanizer66.5K+3.0K3741 days ago
    Category median114.9K+4.0K63—
    Compare freellmapi with claude-mem, ECC, graphify →

    Discover Repositories

    Search across tracked repositories by name or description