dex8-sdk
DEX8 SDK is a library which helps developers to create DEX8 crawler, scraper tasks or automated serverless scripts.
2.14.0 • Published 2 years ago
Spider Packages
doc-dl
doc downloader
develop-seven-frozen-biggest
develop-seven-frozen-biggest
dataspider
数据挖掘机
crt-scrapper
Easily create a scraper api with the @web/scrapper library, which includes a scraper and advanced events for your website.
crawlyx
Crawlyx is an open-source command-line interface (CLI) based web crawler built using Node.js. It is designed to crawl websites and extract useful information like links, images, and text. It is lightweight, fast, and easy to use.
crawl_fetcher
A web crawler. Automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.
crawlab-node-sdk
sdk for crawlab nodejs runtime add data to result collection
crawler-lian
A configuration - based crawler framework
declarative-scraper
Simple & Human-Friendly HTML Scraper with Json-ld support
exclusion
A simple, RFC-compliant robots.txt parser
fast-spider
A simple and fast crawler tool based on node
farmer-site-cli
站长工具，爬取网站网页数据，命令行式操作，无需代码编写。
enispider
A Node.js scraping framework built on puppeteer (to use a headless Chrome/Chromium browser)
flash-spider
闪电般的爬图软件
freeproxylists-scrapper
Page scrapper that retrieves proxy server information from FreeProxyLists website