gocolly/colly
Elegant Scraper and Crawler Framework for Golang
Build with Backblaze B2
SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.
Loading star history...
Where it stands
Rank, growth pace and release cadence relative to everything GStars tracks.
No releases in the last 90 days; the most recent was 591 days ago, with 116 contributors on GitHub.
Use Cases & Benefits
- Provides a fast and elegant web scraping and crawling framework for Go developers to extract structured data from websites.
- Offers a clean API with high performance, automatic cookie handling, concurrency control, and support for distributed scraping.
- Use for building custom web crawlers to collect data from multiple linked web pages efficiently.
- Use for automating data mining tasks that require handling sessions, delays, and robots.txt compliance.
- Use for creating scalable scrapers that run synchronously or asynchronously with caching and encoding support.
Should you depend on it?
License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.
License
Apache 2.0
Permissive: commercial use, modification and redistribution are allowed with attribution; includes an explicit patent grant from contributors.
Community files
- README: present
- Contributing guide: present
Watch-outs
No watch-outs from GStars' checks.
General guidance from repository metadata, not legal advice. How we score
From the README
Lightning Fast and Elegant Scraping Framework for Gophers
Colly provides a clean interface to write any kind of crawler/scraper/spider.
With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving.
See examples folder for more detailed examples.
Daily snapshots
Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots
Forks
1.9K+2
Open issues
195+2
Compared with peers in Automation
Fastest-growing repositories GStars tracks in this cohort for the week of Nov 8, by 7-day star growth
| Repository | Stars | +7d | Health | Last release |
|---|---|---|---|---|
| vercel-labs/agent-desktop | 21.4K | +8.7K | 75 | 5 days ago |
| D4Vinci/Scrapling | 101.1K | +6.3K | 75 | 6 days ago |
| harry0703/MoneyPrinterTurbo | 142.0K | +3.8K | 75 | 3 days ago |
| superplanehq/superplane | 9.8K | +1.0K | 75 | 13 days ago |
| gosom/google-maps-scraper | 7.9K | +622 | 75 | 2 days ago |
| gocolly/colly | 25.6K | — | 40 | 591 days ago |
| Category median | 21.4K | +3.8K | 75 | — |
Discover Repositories
Search across tracked repositories by name or description