Web-crawler Packages

PhantomJS sitemap generator

Web Crawler to create directed graph of links among connected sites. Runs with Node.js and stores data with Redis

Download README files from GitHub repository links

Web crawler for Node.js

A snazzy light Node.js image crawler laced with TypeScript goodness! 🕵️🦾

基于Node.js的网络爬虫(轻量版)，该版本不支持动态页面爬取。

基于Node.js的网络爬虫

gRPC tokio based web crawler

Puppeteer-based image search engine scraper.

Web Crawler MCP

A powerful web crawler and knowledge processing toolkit for extracting and managing web content

Unofficial books.com.tw API

Unofficial National Bibliographic Information Network API

MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content