nodejs-web-scraper
A web scraper for NodeJs
6.1.3 • Published 3 years ago
Web crawler Packages
crawler-ninja
A web crawler made for the SEO based on plugins. Please wait or contribute ... still in beta
@warren-bank/node-request-cli
An extremely lightweight HTTP request client for the command-line. Supports: http, https, proxy, redirects, cookies, content-encoding, multipart/form-data, multi-threading, recursive website crawling and mirroring.
google-news-scraper
Lightweight async scraper for Google News
trawl-4
A full-fledged node.js web crawler with a MySQL backend
turbocrawl
The simple and fast crawling framework. So you can focus on scraping.
spidey
Robust web spider for Node.js
webscrapinglang
Web Scraping Language CLI from https://scrape.it
webscrapinglang-cli
Web Scraping Language CLI from https://scrape.it
wslang
Web Scraping Language CLI from https://scrape.it
openwebspider
Open Source Web Crawler
samritabakshi
Web Crawler
foundrybot
Foundrybot API wrapper
tcrawl
Command Line Interface for Turbo Crawl
web-walk
A simple, easy to use web crawler.
@samritabakshi/slugger
Web Crawler
syphonx
SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or size. It combines the power of CSS Selectors and jQuery, Regular Expressions, and Javascript into a declarative template format to elegantly solve the simplest
gutenbergscraper
A Scraper for Project Gutenberg allowing you to use it for scraping data into datasets, very customizable and friendly
melona
멜론 음원 서비스의 여러 데이터를 JSON으로 변환하는 크롤러
@umarkhan9166/webcrawler
A CLI web crawler written in TypeScript