Crawler Packages

Fast, smart jandan.net/ooxx crawler

Gollum is specialized crawler in cinemas sites.

PhantomJS-based web crawler with support for sitemap, static content, and fragment routing.

A grunt crawler to list all cookies on urls using phantomjs

Google Maps Place crawler

A bot to crawl impots.gouv.fr

simple cli-tool to get images from the website

gSpider

gsping ====================

抓取电商网站的商品信息，暂时只支持淘宝、天猫

Get product info by barcode

Page scrapper that retrieves proxy server information from HideMyAss website

dealing with web robot detect

A toolkit for https://hakka.dict.edu.tw/hakkadict/index.htm

a module to crawl entries in the German commercial register (Handelsregisterbekanntmachungen). A very German module..

Distributed web crawler powered by Headless Chrome

A crawler implemented using a headless browser (Chrome).

Crawl an instagram profile by id

Simple javascript web-crawler with command line interface