GStars
    D4Vinci

    D4Vinci/Scrapling

    #8 this week

    🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

    ai
    automation
    testing
    ai-scraping
    crawler
    crawling
    crawling-python
    data
    Python
    BSD-3-Clause
    98.1K stars
    10.3K forks
    345 GitHub watchers
    Updated Nov 6, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    Ranks #2 among AI repositories ranked this week, and #5 over the last 30 days; #8 of 182 repositories with measured growth this week (top 4%).

    This week's +6,876 stars is ahead of its 30-day pace of about +2,784 per week.

    5 releases in the last 90 days, the latest 1 day ago, with 53 contributors on GitHub.

    Peaked at #8 in the weekly ranking the week of Nov 1, its best in the past year.

    Use Cases & Benefits

    • Provides an adaptive Python web scraping framework supporting single requests to full-scale concurrent crawls with automatic element relocation and anti-bot bypass.
    • Delivers robust scraping with smart element tracking, multi-session support, proxy rotation, and pause/resume capabilities in a single, high-performance library.
    • Use for building scalable, stealthy crawlers that handle dynamic websites and bypass Cloudflare protections automatically.
    • Use for extracting structured data from frequently changing websites using adaptive selectors that relocate elements after page updates.
    • Use for integrating AI-assisted scraping workflows via the built-in MCP server to optimize data extraction and reduce token usage.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    BSD 3-Clause

    Permissive: commercial use, modification and redistribution are allowed with attribution.

    Community files

    • README: present
    • Contributing guide: present
    • Code of conduct: present

    Watch-outs

    No watch-outs from GStars' checks.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.

    Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation — all in a few lines of Python. One library, zero compromises.

    Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular users, there's something for everyone.

    Or scale up to full crawls

    Excerpt from the D4Vinci/Scrapling README on GitHub (BSD-3-Clause license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Aug 18: +84Aug 31: +90Sep 1: +297Sep 2: +130Sep 12: +220Sep 13: +91Sep 14: +342Sep 15: +86Sep 18: +332Sep 19: +197Oct 2: +221Oct 3: +241Oct 4: +225Oct 5: +165Oct 6: +145Oct 7: +175Oct 8: +211Oct 9: +150Oct 10: +167Oct 11: +153Oct 12: +76Oct 13: +121Oct 14: +326Oct 15: +275Oct 16: +298Oct 17: +204Nov 3: +1,091Nov 4: +1,986Nov 5: +1,700Nov 6: +1,544

    +23,306 stars over 81 days across 37 snapshot days; best day +1,986 on Nov 4.

    Forks

    10.3K+2.8K

    Open issues

    14+7

    Compared with peers in AI

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth

    View category →
    D4Vinci/Scrapling compared with AI repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    thedotmack/claude-mem113.6K+8.8K35today
    D4Vinci/Scrapling98.1K+6.9K651 day ago
    Leonxlnx/taste-skill110.7K+5.2K551 day ago
    calesthio/OpenMontage77.2K+4.2K40—
    heygen-com/hyperframes79.6K+4.1K45today
    github/spec-kit147.9K+4.0K45today
    Category median110.7K+4.2K45—
    Compare Scrapling with claude-mem, taste-skill, OpenMontage →

    Discover Repositories

    Search across tracked repositories by name or description