Easy to use lightweight web crawler（易用的轻量化网络爬虫）
Stars, forks and merged pull requests each day or month, lined up with the repository's rank on Trendshift Trending
Oct 8, 2026
Stars +0 in 1 day
Forks +0 in 1 day
Merged PRs 0 in 1 day
Trendshift Trendingwhere the repository ranked each day it made the top 25
Not in the Trendshift top 25 in this period
| Day | Stars gained | Forks gained | Merged PRs |
|---|---|---|---|
| Thu, Oct 8, 2026 | +0 | +0 | 0 |
| Total | +0 | +0 | 0 |
一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.
Apache Nutch is an extensible and scalable web crawler
🕷️ The progressive PHP crawler framework! 优雅的渐进式PHP采集框架。
Pholcus is a distributed high-concurrency crawler software written in pure golang
DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
《我用爬虫一天时间“偷了”知乎一百万用户，只为证明PHP是世界上最好的语言 》所使用的程序
Scrapy, a fast high-level web crawling & scraping framework for Python.
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.
