Spider Packages

A generic crawler interface

极简网络蜘蛛爬虫，适用任何网站，只需设置一条规则，就可以把你想要网站上的内容整理出来，非常方便，简单！

豆瓣爬虫小工具 By Node.js.

Ananse is a lightweight NodeJs framework with batteries included for building efficient, scalable and maintainable USSD applications.

Get Aliexpress product details as a json reponse including feedbacks, variants, description, images, etc.,

Get Aliexpress product details as a json reponse including feedbacks, variants, description, images, etc.,

Get Chrome Path for Puppeteer

Create Browser with Puppeteer for Crawl

ZSpider Core

Utils for web resources. Get a web page and save to disk (with minimal dependencies)

acfun文章区爬虫工具

article-pull

[]() []() []() [![

A web crawler. Automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

sdk for crawlab nodejs runtime add data to result collection

A configuration - based crawler framework

Crawlyx is an open-source command-line interface (CLI) based web crawler built using Node.js. It is designed to crawl websites and extract useful information like links, images, and text. It is lightweight, fast, and easy to use.

Easily create a scraper api with the @web/scrapper library, which includes a scraper and advanced events for your website.

数据挖掘机

Simple & Human-Friendly HTML Scraper with Json-ld support