gebeya-crawler v1.0.2

Gebeya-Crawler

Gebeya-Crawler is a web exploring library which can be used for searching a word or a sentence on a web page and its subpages. It is going to go searching on the subpages only if the word is not found in the main page. For the sake of avoiding unrelated searches, the library navigates only the subpages in the same domain with the main page.

In order to use this package, first install the gebeya-crawler package

npm install gebeya-crawler

Then require gebeya-crawler in your code and pass the module the parameters page and word which corresponds to the page you want to explore and the word you want to search respectively

var crawl = require('gebeya-crawler'); 
crawl(<the page>,<the word>);

You should see the number of occurrences of the word and the page in which the word is found.

TODO

Make the library return the appropriate values instead of console logging them. (Needs a work around to return values computed by asynchronous functions like request)