crawlbugA NodeJS web crawler that can be deployed to multiple machines and writes page data to a Firebase database.crawlerspidercrawlbugwebinternet5.0.2 • Published 7 years ago