Crawler | npm.io

puppeteer crawler

puppeteer crawler index visit spider crawl modern google headless chrome

1.2.0 • Published 6 years ago

Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend. This version is forked in order to add the ability to filter by referrer url

simple crawler spider cache queue simplecrawler eventemitter

0.3.1-1.2 • Published 9 years ago

Unofficial APIs for Socialblade.com website.

socialblade social socialmedia scraper scraping crawler api

1.0.0 • Published 5 years ago

crawls a npm package and it's dependencies for their licenses

license crawler checker legal dependency package

0.0.5 • Published 7 years ago

Crawler to download manga from submanga.com and other sites in the future

crawler manga submanga

1.0.9 • Published 9 years ago

Crawls product reviews from Amazon.

amazon reviews crawler

1.0.4 • Published 8 years ago

This is a data crawler

crawler

0.1.1 • Published 8 years ago

A command-line tool for backing up a user's public Tweets in JSON format.

crawler twitter public-timeline

0.0.3 • Published 13 years ago

download entire website with its own directory structure.

crawler

1.0.7 • Published 8 years ago

Yet another node.js torrent scraper based on seek-torrent but made especially for movies, series, anime and music (scrape from 1337x, eztv, limetorrents, rarbg, skytorrents, torrentproject, yts and zooqle)

torrent search crawler seek index download movie series tracker tv

1.2.1 • Published 5 years ago

Another youtube crawler, no API key needed

youtube crawler api list songs videos

0.0.3 • Published 9 years ago

puppeteer crawler

1.3.0 • Published 5 years ago

Lightweight wrapper for Request and X-Ray JS.

HTTP request scraper crawler web x-ray phantom javascript js

0.1.2 • Published 9 years ago

Bumps ulimit on the system so that more files can be opened.

grunt plugin gruntplugin ulimit broken links crawler