dat-hansard
Scrapes data.openaustralia.org to dump data into a dat
1.0.2 • Published 8 years ago
Scraper Packages
dom-extract
Extract HTML from file by DOM Selector
fide-chess
"Scraper for FIDE website"
@sesamestrong/json-scraper
A tool to allow for quick running of JSON-based scrapers using request-promise and jsonframe-cheerio.
magnet-to-clipboard
copy magnets from your termial
@davidlazic/manga-scraper-cli
CLI for scraping hosted manga images to local file system
webcreeper
WebCreeper easy web crawler
wring-with-phantomjs
Extract content from websites using CSS Selectors and XPath
x-ray-2
structure any website
x-ray-nightmare
Nightmare (electron based) driver for the x-ray web scraper.
spidey
Robust web spider for Node.js
streamango-scraper
A scraper for Streamango
streamcloud-scraper
A scraper for Streamcloud
streammoe-scraper
A scraper for StreamMoe
turtlefly
A crawler framework based on NodeJS.
yell2
a yelp scraper which scrapes all reviews of a user given their profile ID.
website-scraper-2
Download website to a local directory (including all css, images, js, etc.)
url-info-scraper
Library to retrieve meta data (title, favicon address etc) from a url
url-metadata2
Request an http url and scrape its metadata.
@mvegter/scrapedin
linkedin scraper for 2020 website