web-content-extractor
extract a web page text content
extract a web page text content
An easy to use CLI for downloading websites for offline usage
Asset Crawler for common Web pages
x-ray's crawler
An attestate crawler strategy to download and transform Ethereum block event logs
fork of https://github.com/sudheer-ranga/aliexpress-product-scraper
A simple module, which can use for checking all link status code, given links. Below shows how to use the module
Papercut is a scraping/crawling library for Node.js, written in Typescript.
blocklet crawler lib
Auxiliary package of functions for the TypeScript framework Botmation focused on Facebook
Auxiliary package of functions for the TypeScript framework Botmation focused on Reddit
Auxiliary package of functions for the TypeScript framework Botmation
A port of n0madic/twitter-scraper to Node.js.
TypeScript types for defining custom metrics
deepcrawl cli
A bot to crawl impots.gouv.fr
IT Events Crawler of China
The unofficial HLTV Node.js API
A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.
A Simple ontology database built from a list of ontologies, with auto-download abilities