List of libraries, tools and APIs for web scraping and data processing.
-
Updated
Oct 27, 2024 - Makefile
List of libraries, tools and APIs for web scraping and data processing.
The All in One Framework to build Awesome Scrapers.
Web data extraction tool implemented as chrome extension
Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.
Instagram user's photos and videos downloader. Download all media files from any username. Working 2022!
Simple library which helps you to retrieve the source of various video streaming sites.
Spin up Tor containers and then proxy HTTP requests via these Tor instances
Zoominfo scraper with using of rotating proxies and headless Chrome from ScrapingAnt
📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).
An declarative and easy to use web crawler and scraper in C#
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Producthunt.com famous website scraper script. Scrap all offers and save in spreadsheet excel file.
GPT4 Assisted Web Scraping Library
Alibaba scraper with using of rotating proxies and headless Chrome from ScrapingAnt
An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)
Building a dataset of Twitter replies for unsupervised learning / bot-blocking
An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)
Python script to automate the download of textbooks from Chegg
Scrappey.js: A versatile JavaScript wrapper for Scrappey API for solving Cloudflare, datadome, enabling seamless web scraping of anti-bot protected websites. Simplify data extraction with robust functionality and reliable results. Unlock valuable insights effortlessly. Get started with Scrappey
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
Add a description, image, and links to the scraping-tool topic page so that developers can more easily learn about it.
To associate your repository with the scraping-tool topic, visit your repo's landing page and select "manage topics."