Spider Packages

The [spider](https://github.com/spider-rs/spider) project ported to Node.js

doc downloader

A Node.js scraping framework built on puppeteer (to use a headless Chrome/Chromium browser)

A simple, RFC-compliant robots.txt parser

A simple and fast crawler tool based on node

闪电般的爬图软件

站长工具，爬取网站网页数据，命令行式操作，无需代码编写。

PhantomJS/Browser lib which allows to parse a webpage

Get Aliexpress product details as a json reponse including feedbacks, variants, description, images, etc.,

Get cjdropshipping product details as a json reponse including feedbacks, variants, description, images, etc.,

URL crawler for analysing web content

类似java中webmagic类似的爬虫框架

A tiny node module to detect spiders/crawlers quickly and comes with optional middleware for ExpressJS

👉 https://hyper.fun/c/fa-spider/1.3.0

Spider - is a simple links checker for web pages

Fetch html with node-fetch.

Fetch special for spider.