0.1.4 • Published 8 years ago
crawl-this v0.1.4
Light weight web crawler
How to install
npm install crawl-this -g
Required versions
node: >=v4.0.0
Usage
Usage: crawl-this options
Options:
-h, --help output usage information
-V, --version output the version number
-d, --depth <depth> Depth to search. Should be a number
example: crawl-this -d 2 http://github.com