js-crawler
Web crawler for Node.js
Web crawler for Node.js
Url scraper which takes the text input and finds the links/urls, scraps them using cheerio and will returns an object with original text, parsed text (using npm-text-parser) and array of objects where each object contains scraped webpage's information.
PhantomJS sitemap generator