web-icon-grabber
Gets icons from any website via manifest file or icon tags
1.0.2 • Published 1 year ago
Crawl Packages
scrape-brrr
Simple web page scraping
scrapingapi
One API to scrape All the Web.
scrapyteer
Web scraping/crawling framework built on top of headless Chrome
sentynel
A CLI tool that crawls your site & produces a report with all snapshots of a specific element/component on that site, including diffs with a prod environment
virtual-crawl
A Roguelike demo
tree-sitter-gambit
programming language
x-crawl
x-crawl is a flexible Node.js AI-assisted crawler library.
@nondef/ts-oai-pmh
OAI-PMH harvester module for nodejs - typescript refactor
@jswork/next-spider-fetch
Fetch special for spider.
@jswork/node-fetch-html
Fetch html with node-fetch.
@jnv/scrapoxy
Scrapoxy is a proxy for scrapers
@mentoc/xtract
Extract values out of deep structures using a safe and simple extraction language.
@lyuboslavlyubenov/logo-scrape
Scrapes/Crawls the logo from a provided url(s)/website for your Node.js applications.
get-sitemap-links
get fetch parse crawl sitemap links recursively.
get-website-text
Get a website's text
manga-crawl-lib
A library for scraping manga from various websites.
manga-lib
A library for scraping manga from various websites.
galaxiat.serve.seo
galaxiat.serve.seo Node.js package allows you to easily cron crawl path that you want to have an html version (for dynamic rendering like React) without have to make SSR when request is passed.
great-reaper
Scrap and collect data from urls, html, json and stuff..