crawlit A node.js crawler support custom crawl rules for special site with a plugin.crawlercrawlspidder0.1.5 • Published 10 years ago