GitHub
Scrapling
#161 of 964 in the AI Agent Index
24 Score
Real usage —
Momentum —
Attention 97
About
Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP
Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.
Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises.
Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular…
Across sources
69.9k Stars
- Stars 69.9k
- Forks 6.9k
- Commits 1.5k
- Releases 49