Crawler Packages

small crawler

This is a simple NPM package which attempts to determine the publication date of a blog post or article when one is not given.

Web Crawler Provider for Chen Framework

Chromeless based Instagram service. No need for API anymore

Checks for mixed content a.k.a. HTTP references on HTTPS, very alpha.

Quickly check the EDUX system for updates @ Polish-Japanese Academy of Information Technology

A development kit for casperjs

Turn any website to serverless API with ease

Data Crawler for CDO (Climate Data Online) web services

A DOM crawler to extract results from https://www.mytischtennis.de/clicktt/home/

爬虫下载插件

nodejs web crawl tool

crawler request tool

A crawler framework, just my experience.

Command-line interface for bauer-crawler.

Plugin for bauer-crawler to convert CSV into JSON.

Plugin for bauer-crawler to extract values from JSON data.

Plugin for bauer-crawler to make http requests.

Plugin for bauer-crawler to list files with node-glob.

Plugin for bauer-crawler to convert PDF into text.