GStars
    unclecode

    unclecode/crawl4ai

    Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

    llm
    ai
    ai-agents
    crawl4ai-cloud
    crawler
    data-extraction
    Python
    Apache-2.0
    87.1K stars
    9.1K forks
    424 GitHub watchers
    Updated Nov 9, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    3 releases in the last 90 days, the latest 26 days ago, with 94 contributors on GitHub.

    Peaked at #13 in the weekly ranking the week of Sep 14, its best in the past year.

    Use Cases & Benefits

    • Transforms websites into clean, LLM-ready Markdown and structured data for AI agents and retrieval-augmented generation workflows.
    • Offers fast, adaptive crawling with full browser control, stealth mode, and customizable extraction strategies without API rate limits or lock-in.
    • Use for building data pipelines that require clean, semantic Markdown outputs from dynamic or JavaScript-heavy websites.
    • Use for extracting structured JSON data from repetitive web patterns using CSS selectors or LLM-driven schema extraction.
    • Use for deploying scalable, secure web crawling services via Docker or cloud with session management and proxy support.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    Apache 2.0

    Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Crawl4AI turns the web into clean, LLM ready Markdown for RAG, agents, and data pipelines. Fast, controllable, battle tested by a 50k+ star community.

    ✨ New in v0.7.4: Revolutionary LLM Table Extraction with intelligent chunking, enhanced concurrency fixes, memory management refactor, and critical stability improvements. Release notes →

    ✨ Recent v0.7.3: Undetected Browser Support, Multi-URL Configurations, Memory Monitoring, Enhanced Table Extraction, GitHub Sponsors. Release notes →

    Excerpt from the unclecode/crawl4ai README on GitHub (Apache-2.0 license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Aug 13: +38Aug 31: +440Sep 1: +210Sep 2: +328Sep 3: +92Sep 4: +82Sep 5: +263Sep 6: +261Sep 7: +37Sep 14: +257Sep 15: +184Sep 16: +71

    +9,214 stars over 90 days across 19 snapshot days; best day +440 on Aug 31.

    Forks

    9.1K+1.0K

    Open issues

    323+178

    Compared with peers in LLM

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth

    View category →
    unclecode/crawl4ai compared with LLM repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    NVIDIA/auto-ontology11.4K+8.5K75—
    thedotmack/claude-mem115.8K+4.7K75today
    DietrichGebert/ponytail188.4K+4.4K7512 days ago
    affaan-m/ECC300.8K+4.3K7540 days ago
    Graphify-Labs/graphify145.7K+3.8K75today
    unclecode/crawl4ai87.1K—6426 days ago
    Category median145.7K+4.4K75—
    Compare crawl4ai with auto-ontology, claude-mem, ponytail →

    Discover Repositories

    Search across tracked repositories by name or description