Scraping Packages

Png file downloader

fork from headless-chrome-crawler and update puppeteer to the latest version

Scrape instagram posts from Username, Hashtag or Location pages. Download media and save them to a ZIP archive. Create JSON/CSV files with a post information. No login required

Scrape instagram posts from Username, Hashtag or Location pages. Download media and save them to a ZIP archive. Create JSON/CSV files with a post information. No login required

A dream R&D tool for web scraping.

Heavyweight scraping framework for mobsters

Easy get functions for scraping sites

download all twitter data by scraping without api token using puppeteer.

A simple library to scrape ArenaVision events

Serves as an independent data scraping module, complete with ontology and full scraping ability for the CIA World Leaders site

scraped coinmarketcap of top 100

Use Puppeteer to download pens from Codepen.io as single html pages.

Node scraping tool (WIP)

Crawler Second-system effect,the second development

Serves as an independent data scraping module, complete with ontology and full scraping ability for the MCIA country handbooks.

crawler util

A simple web crawler

Crawler: Single library for static and dynamic scraping needs.

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!

Web crawler