D4Vinci/Scrapling
在全部 GitHub 仓库 中按Star排名第 17(共 813)
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
项目介绍
Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP
Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.
Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation - all in a few lines of Python. One library, zero compromises.
Blazing fast crawls with real-time stats and streaming. Built by Web Scrapers for Web Scrapers and regular…
最新指标
| Star | 89.7k | 2026-10-26 |
|---|---|---|
| Fork | 9.3k | 2026-10-26 |
| 提交 | 1.8k | 2026-10-26 |
| 发布 | 54 | 2026-10-26 |
| Watcher | 321 | 2026-10-26 |
| 开放 issue | 4 | 2026-10-26 |
| 开放 PR | 16 | 2026-10-26 |