Spider Packages

Simple and powerful crawler. It scraps content and collects links from websites using request or phantomjs. The whole magic and simplicity is behind configuration.

## Dom selection tool based on cheerio.js

小说爬虫服务

Lightweight crawler that works like a real browser

fetch webpage content after phantom rendered

Starter Template for testing PhantomJS ‘Applications’ with Jasmine, Grunt, and Istanbul

A web spider app, it converts a page into a json object

Utility built on top of headless Chrome

An intelligent proxy and request manager.

crawling data from website by nodejs

transform github-trending repos to json data

Given a username, GIC will crawl through their repositories grabbing all issues and outputting them to a local folder.

Given a username, GIP will crawl through their repositories grabbing all issues and outputting them to a local folder as PDFs.

simple cli-tool to get images from the website

gSpider

抓取电商网站的商品信息，暂时只支持淘宝、天猫

Compile spider script into javascript.

Compile Spider to JavaScript with Gulp

Page scrapper that retrieves proxy server information from HideMyAss website

A crawler implemented using a headless browser (Chrome).