Crawler Packages

The unofficial HLTV Node.js API

HLTV Node.js API

Distributed web crawler powered by Headless Chrome

A web-crawler and scraper that extracts data from a family of nested dynamic webpages with added enhancements to assist in knowledge mining applications.

Instagram media scrapper

Used in the creation of plugins (aka reports) that present data or visualizations for a website in aggregate, across site content. For use with InterroBot application.

Export Instagram profiles and collections to git-ified and version controllable achieves

Powerful Scraping and Crawling library with anti-scraping, scalability, storage, static/dynamic contents, monitoring UI and more. Ready to deploy on cloud instances or serverless.

Automated crawling and messaging for LinkedIn

Scraper for getting data about companies and users

FFXIV Lodestone news crawler

This tool helps you to generate lighthouse reports for provided sitemap URL & compare them effortlessly.

A tool to get information about the contests on each OJ

A lightweight and simple API for web crawling built on chromium puppeteer

A lib for programmatic access to manga on diverse sources.

parse html or json

A web scraper for the Serbian listings site KupujemProdajem

a configureable distributed crawler

MCP server for FireCrawl web scraping integration. Supports both cloud and self-hosted instances. Features include web scraping, batch processing, structured data extraction, and LLM-powered content analysis.

A web crawler module designed to scarp data from Ptt.