@acq/er
A util tool
0.2.2 • Published 6 years ago
Crawler Packages
@acq/gallery
A downloader
@acq/local-rand
A util tool
@acq/parse-path
A path parser
@acq/path
A path parser
@adactiveasia/apify-client
Apify API client for JavaScript
@adibenmatdev/web-auto-extractor
Automatically extracts structured information from webpages - with json repair
@adncorp/apify
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
@algolia/404-crawler
Detect 404/Not found pages from sitemap
@albert-team/spiderman
Minimalistic web crawler for Node.js
@binochoi/aliexpress-scraper
fork of https://github.com/sudheer-ranga/aliexpress-product-scraper
@beermonster/hltv
The unofficial HLTV Node.js API
@black_meteor/check-link-status
A simple module, which can use for checking all link status code, given links. Below shows how to use the module
@blocklet/crawler
blocklet crawler lib
@benchristel/supercrawler
A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.
@celebi/cheerio-extract
Get information using the string of the specified rule
@cassidyai/crawlee-root
The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
@citoyasha/yt-search
Youtube Crawler with no API that returns 3 first videos.
@cicadancr/twitter-scraper
A port of n0madic/twitter-scraper to Node.js. Ported from @the-convocation. Custom funcs.
@catdevnull/twitter-scraper
A port of n0madic/twitter-scraper to Node.js.