Crawling Packages

Scrapoxy is a proxy for scrapers

Distributed web crawler powered by Headless Chrome

Set of utils and queues to make web scraping easy.

Minimalist Node.js web scraper and crawler working with under-the-hood JSDOM

naver stock data crawler

🤛🏻 Regular Expression Data Grabber

Build web scraping agents using AI to auto-extract the data from websites

One API to scrape All the Web.

Web scraping/crawling framework built on top of headless Chrome

Sasori is a dynamic web crawler powered by Puppeteer, designed for lightning-fast endpoint discovery.

proxidoor helps you make HTTP requests through a rotating proxy, you can use it for services such as web scraping, web crawling and more.

Real Fish Youtube Video Crawling Module

Real Fish Youtube Trend Video Crawling

Crawler (spider) of site web pages by domain name

Easily scrap the web for torrent and media files.

Easily crawl your public notion pages

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

NodeCraw is a web crawling application that allows you to crawl specified URLs and extract information from web pages. It utilizes various modules and libraries to perform crawling and save the results.

PhantomJS sitemap generator

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.