bilibili-live-crawler
a crawler which made to monitor bilibili livestream data, using influxdb.
0.1.2 • Published 5 years ago
Crawler Packages
authcov
Web app authorization coverage scanning using Chrome headless browser
boilerpipe-scraper
Boilerpipe Modification for Node.js
btcnews
A bitcoin news crawler
easydomscrapper
An extremely simple module to web scrapper a DOM element(s)
email-crawler
"a service for scraping emails from a webpage, given the number of levels to reach
fight-matrix
Crawls and parses FightMatrix.com
floob
Floob is a simple web crawler which can run several plugins to analyze each page.
get-set-fetch
web crawler, parser and scraper with storage capabilities
ctripcrawler
A scraper for collecting ticket data from ctrip.com
article-parser-cli
CLI-based for article-parser module
nodejs-spider2
基于nodejs+puppeteer的网络爬虫
thief-cli
Thief CLI =========
kinomania
bot to download pictures from kinomania.ru
wintr
Wintr (wintr.com) unofficial API wrapper
wikipedia-crawler
It all leads to philosophy
wafjs
Simple WAF to integrate with Node.js web systems
web-htmlparser
moved to web-automation.
w3c-validator
Crawls a given site and checks for W3C validity.
w3c-validator-cli
Crawls a given site and checks for W3C validity.