Crawler Packages

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

Templates for the crawlee projects

The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

TypeScript types for defining custom metrics

deepcrawl cli

a web crawler, crawl book from https://www.douban.com/

🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.

A library for efficiently walking a directory recursively

A JavaScript libary to easily use SpeedyShot's capture service

A bot to crawl impots.gouv.fr

A Simple ontology database built from a list of ontologies, with auto-download abilities

IT Events Crawler of China

The [spider](https://github.com/spider-rs/spider) project ported to Node.js

A MCP-based documentation crawler service

MCP server for Firecrawl web scraping integration. Supports both cloud and self-hosted instances. Features include web scraping, batch processing, structured data extraction, and LLM-powered content analysis.

Hyperbrowser Model Context Protocol Server

Detect user-agent is a bot/spider/crawler