Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
go
docker
platform
crawler
spider
web-crawler
scrapy
webcrawler
scrapyd-ui
webspider
crawling-tasks
crawlab
spiders-management
-
Updated
Nov 26, 2024 - Go