aiagent.club
中文
GitHub

Scrapling

#161 of 964 in the AI Agent Index

24 Score
Real usage
Momentum
Attention
97

About

Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP

Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.

Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises.

Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular…

Across sources

69.9k Stars
  • Stars 69.9k
  • Forks 6.9k
  • Commits 1.5k
  • Releases 49