Crawling Packages

Distributed web crawler powered by Headless Chrome

Sandbox network youtube comment crawling library

Sandbox network youtube comment analyze library

Extensible web crawler with page object design pattern.

SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or size. It combines the power of CSS Selectors and jQuery, Regular Expressions, and Javascript into a declarative template format to elegantly solve the simplest

Scrapy Framework implemented by nodejs.

A Node.js scraping framework built on puppeteer-core (to use a headless Chrome/Chromium browser). The core module without browser installation

A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser). Has the ability to solve reCaptcha

A Node.js scraping framework built on puppeteer-extra (to use a headless Chrome/Chromium browser). Has the ability to solve reCaptcha. The core module without browser installation

A set of shared utilities that can be used by crawlers

A damn simple tool to extract json-ld metadata from webpage using jquery like api (jQuery, Cheerio, CashDOM, ...).

keyword mention 크롤러

A damn simple tool to extract json-ld metadata from webpage using jquery like api (jQuery, Cheerio, CashDOM, ...).

Package to find style links from the site you want

spamlet is an efficient and simple crawler for playwright

Fast asynchronous NodeJS module for crawling/scraping a web through worker_threads.

Datasco API SDK for Node.js to collect any data from any website

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously

A Simple Job Manager

PhantomJS/Browser lib which allows to parse a webpage