0.1.0 • Published 8 years ago

poor_crawler v0.1.0

Weekly downloads
-
License
ISC
Repository
-
Last release
8 years ago

poor_crawler - simple crawler

How to use :

var Crawler = require('./crawler.js');

var myCrawler = new Crawler();
myCrawler.extractFromUrl("http://myPage.com");

where "http://myPage.com" is the startup point. You can try it by typing :

node test.js

The result are not stored anywhere but in the console, and the program will brake when the array stocking the visited adress is full.

0.1.0

8 years ago