phantomjs-sitemap-generator
PhantomJS sitemap generator
0.1.6 • Published 8 years ago
Crawler Packages
lodestone-news
FFXIV Lodestone news crawler
directory-crawler
The directory crawler library for Node.JS
lscontests
A tool to get information about the contests on each OJ
dex8-cli
Dex8 CLI is a command line interface which helps developers to create and run dex8.com skripts (automated serverless scripts).
dex8-lib
DEX8 Library used in DEX8 platform to build DEX8 robot tasks.
dex8-sdk
DEX8 SDK is a library which helps developers to create DEX8 crawler, scraper tasks or automated serverless scripts.
path-crawler
An utility to crawl generic objects paths
dc-crawler
A set of Web Scraping robots to get Dragon City data from websites.
limador
Powerful Scraping and Crawling library with anti-scraping, scalability, storage, static/dynamic contents, monitoring UI and more. Ready to deploy on cloud instances or serverless.
pdf-crawler
A simple Node.js version pdf download crawler
pdfdataextract
Extract data from a pdf with pure javascript
@fcc-cdc/it-events
IT Events Crawler of China
@feup-infolab/ontologies-database
A Simple ontology database built from a list of ontologies, with auto-download abilities
octopus-web-crawler
Another web crawler.
croton
Nexstack Nodejs library that provides an Api for obtaining the movies information website.
playwright-afp
Stop website fingerprinting techniques playwright edition
poor_crawler
simple program to fetch urls
portadom
Single DOM manipulation interface across Browser API, JSDOM, Cheerio, Playwright
declarative-scraper
Simple & Human-Friendly HTML Scraper with Json-ld support