Spider Packages

Easily scrap the web for torrent and media files.

A structural framework for creating good bots

A lightweight node spider

NodeCraw is a web crawling application that allows you to crawl specified URLs and extract information from web pages. It utilizes various modules and libraries to perform crawling and save the results.

post-ball-coming8

An easy, lightweight scraper for humans with many inbuilt features..

Explore the Web

科大讯飞爬虫API


Web crawling tool

搜索工具

for extract emails you can use this npm package html-email-extractor which is light weight.

A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added enhancements to assist in knowledge mining applications.

Used in the creation of plugins (aka reports) that present data or visualizations for a website in aggregate, across site content. For use with InterroBot application.

A web crawler module designed to scarp data from Ptt.

utils for web-spider, easy to use

定义一个json格式的爬虫规则，Nodejs按照该规则爬取所需要的内容

An easy, lightweight scraper for humans with many inbuilt features..