Crawler Packages

Crawls given domains to provide a site map of static assets

A module to analyse websites for SEO, validation and code-quality

A sitemap crawler for webcheck

A helper that build a x-ray based on a schema

Crawls all international Spotify pages and returns prices for each country.

iSpider is a simple and fast web spider written with Nodejs!

typestub of crawler

Simple torrent search engine

node SDK for zaoshu.io

Simple but powerful es6 based crawler/spider

Web crawler test script

monitor crawler

Open Source Web Crawler

Crawls a website and lists or downloads all resources

Another DHT crawler written in Node.js

Crawler top google is based keyword

Lightweight robots.txt parsing component without any external dependencies for Node.js.

Web Crawler in Node.js to spider dynamically whole websites.

Get a webpage and select elements with jquery