nodejs-web-scraper
A web scraper for NodeJs
6.1.3 • Published 1 year ago
Web crawler Packages
crawler-ninja
A web crawler made for the SEO based on plugins. Please wait or contribute ... still in beta
@warren-bank/node-request-cli
An extremely lightweight HTTP request client for the command-line. Supports: http, https, proxy, redirects, cookies, content-encoding, multipart/form-data, multi-threading, recursive website crawling and mirroring.
google-news-scraper
Lightweight async scraper for Google News
trawl-4
A full-fledged node.js web crawler with a MySQL backend
turbocrawl
The simple and fast crawling framework. So you can focus on scraping.
spidey
Robust web spider for Node.js
webscrapinglang
Web Scraping Language CLI from https://scrape.it
webscrapinglang-cli
Web Scraping Language CLI from https://scrape.it
wslang
Web Scraping Language CLI from https://scrape.it
samritabakshi
Web Crawler
openwebspider
Open Source Web Crawler
foundrybot
Foundrybot API wrapper
tcrawl
Command Line Interface for Turbo Crawl
@samritabakshi/slugger
Web Crawler
web-walk
A simple, easy to use web crawler.
@umarkhan9166/webcrawler
A CLI web crawler written in TypeScript
gnews-scraper
GNewsScraper is a TypeScript package that scrapes article data from Google News based on a keyword or phrase. It returns the results as an array of JSON objects, making it convenient to access and use the scraped information
@xkairo/scrapy
Framework to scrape data from web pages
@xkairo/scrapy-puppeteer-plugin
Puppeteer integration to Scrapy library