Scraping Packages

PDF Text Scraping

Scrape a webpage with given URL, parse and extract microdata (schema.org) and return a JSON.

Simple scraper for imitating browsing sessions

The error crawler that powers http://plucky.io/

Scrape instagram posts by username, shortcode, or hashtag

Lightweight scraper written in TypeScript using ES6 generators.

NodeJS module NPM package that helps to scrap and load instagram profile media, posts comments and more useful information.

A price scraper for Amazon

A highly configurable website crawler for automatically testing a website for accessibility issues using the axe-core library. Uses selenium and headless Chrome to load pages, inject axe-core, and run tests. Generates an html summary report in addition

data score for bet365

scraping tool

Test Utils for the SourceScraper-Project

tiny-crawler is a web crawler.

Data extraction tools.

Normalization of DOM table rows - creates a matrix with duplicate cells based on rowspan and colspan

Node.js web scraping as pipeline

Smart & Flexible JavaScript written Web scraper

CLI tool to get text contents of a URL.

A simple node package scraping a web page and spitting the results in a CSV file.

Scraped the instagram