crawl-url
A npm command line utility to crawl images of an url or set of urls.
1.0.4 • Published 10 years ago
Crawl Packages
crawl2tweet
Crawl web pages to tweet new articles
crawl_holiday_data
crawl holiday data
crawlit
A node.js crawler support custom crawl rules for special site with a plugin.
badboy
Crawl apps from Google Play & iTunes
auicrawler
tools for crawl android app ui nodes
downtune.js
Crawl data or download files from website with custom rules
ecrawler-parser
html, xml, json, feed parser
tcrawl
Command Line Interface for Turbo Crawl
kaiser-crawler
Node.js module for crawling the web
@crstn/redirect
A small package to crawl a site and return a redirect template. This is helpful for migration from one to another website with different url schemes.
web-spider-go
``` npm i web-spider-go -S
unsplash-scraper
## Easily Scrape Images from [Unsplash.com](https://unsplash.com/) based on your own search items
@folder/readdir
Recursively read a directory, blazing fast.
@samritabakshi/slugger
Web Crawler
@remy/snap
Creates a snapshot of a url with HTML suffix removed in favour of directories
mrspider-regex-data-extractor
mrspider middleware to extract data using regular expressions.
mycrawl
craw a definite web
mix-utils
Generic utility functions (Mixin Lodash)
phantomjs-test-starter
Starter Template for testing PhantomJS ‘Applications’ with Jasmine, Grunt, and Istanbul