Web-crawler Packages

Scan given website recursively and report 404 links

A web scraper for NodeJs

PhantomJS sitemap generator

Web Crawler to create directed graph of links among connected sites. Runs with Node.js and stores data with Redis

Download README files from GitHub repository links

Web crawler for Node.js

A snazzy light Node.js image crawler laced with TypeScript goodness! 🕵️🦾

Web Crawler MCP

A powerful web crawler and knowledge processing toolkit for extracting and managing web content

Unofficial books.com.tw API

Unofficial National Bibliographic Information Network API

MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content

基于Node.js的网络爬虫(轻量版)，该版本不支持动态页面爬取。

基于Node.js的网络爬虫