scrapy

    scrapy/scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    automation
    crawler
    crawling
    framework
    hacktoberfest
    python
    scraping
    web-scraping
    web-scraping-python
    Python
    BSD-3-Clause
    58.6K stars
    11.1K forks
    58.6K watching
    Updated 2/27/2026
    View on GitHub
    Backblaze Advertisement

    Loading star history...

    Health Score

    20.12

    Weekly Growth

    +0

    +0.0% this week

    Contributors

    1

    Total contributors

    Open Issues

    687

    Generated Insights

    About scrapy

    |logo|

    .. |logo| image:: https://raw.githubusercontent.com/scrapy/scrapy/master/docs/_static/logo.svg :target: https://scrapy.org :alt: Scrapy :width: 480px

    |version| |python_version| |ubuntu| |macos| |windows| |coverage| |conda| |deepwiki|

    .. |version| image:: https://img.shields.io/pypi/v/Scrapy.svg :target: https://pypi.org/pypi/Scrapy :alt: PyPI Version

    .. |python_version| image:: https://img.shields.io/pypi/pyversions/Scrapy.svg :target: https://pypi.org/pypi/Scrapy :alt: Supported Python Versions

    .. |ubuntu| image:: https://github.com/scrapy/scrapy/workflows/Ubuntu/badge.svg :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AUbuntu :alt: Ubuntu

    .. |macos| image:: https://github.com/scrapy/scrapy/workflows/macOS/badge.svg :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AmacOS :alt: macOS

    .. |windows| image:: https://github.com/scrapy/scrapy/workflows/Windows/badge.svg :target: https://github.com/scrapy/scrapy/actions?query=workflow%3AWindows :alt: Windows

    .. |coverage| image:: https://img.shields.io/codecov/c/github/scrapy/scrapy/master.svg :target: https://codecov.io/github/scrapy/scrapy?branch=master :alt: Coverage report

    .. |conda| image:: https://anaconda.org/conda-forge/scrapy/badges/version.svg :target: https://anaconda.org/conda-forge/scrapy :alt: Conda Version

    .. |deepwiki| image:: https://deepwiki.com/badge.svg :target: https://deepwiki.com/scrapy/scrapy :alt: Ask DeepWiki

    Scrapy_ is a web scraping framework to extract structured data from websites. It is cross-platform, and requires Python 3.9+. It is maintained by Zyte_ (formerly Scrapinghub) and many other contributors_.

    .. _many other contributors: https://github.com/scrapy/scrapy/graphs/contributors .. _Scrapy: https://scrapy.org/ .. _Zyte: https://www.zyte.com/

    Install with:

    .. code:: bash

    pip install scrapy
    

    And follow the documentation_ to learn how to use it.

    .. _documentation: https://docs.scrapy.org/en/latest/

    If you wish to contribute, see Contributing_.

    .. _Contributing: https://docs.scrapy.org/en/master/contributing.html

    Discover Repositories

    Search across tracked repositories by name or description