Nodejs Packages

mrcrawler

MrCrawler is a simple but powerful crawler engine that you can use to broad crawl with no eforce. MrCrawler is built on top of Puppeteer and Playwright. You can also use Redis with a built in worker distribuiter allowing you use MrCrawler concurrently in

1.0.1 • Published 4 years ago