magnet-getter
An API to get magnet links using Puppeteer.
An API to get magnet links using Puppeteer.
A simple command0line tool to crawl and test your website
WebCreeper easy web crawler
A 2nd generation spider to crawl any article site, automatic reading title and content.
A tool for getting public website content using a browser engine or http get.
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!
Node Web Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!
easily create crawlers based on self-replicated scrapers
The most advanced web crawler for JavaScript
A Wight backend for fetching static web pages
NodeJS Crawler for Twitter
Distributed web crawler powered by Headless Chrome
NodeJs crawling & scraping framework heavily inspired by Scrapy (Pyhton)
Extraction of text and related metadata.
Lightweight crawler written in TypeScript using ES6 generators.
Thief CLI =========
web scraper for album reviews from pitchfork
Node.js web scraping utility powered by puppeteer pool
NodeJS Crawler for Twitter
Moving or backing up your Wordpress site to Blogger