Webcrawling Packages

Url scraper which takes the text input and finds the links/urls, scraps them using cheerio and will returns an object with original text, parsed text (using npm-text-parser) and array of objects where each object contains scraped webpage's information.

Helper classes for validating, filtering, and normalizing URLs in bulk