1.0.0 • Published 3 years ago
scrapethenslide v1.0.0
Venue Info Scraper
The name is pretty self-explanatory, leverages the yelp-fusion
API to get information on given venues.
Installation
git clone https://github.com/iCalculated/venueScraper.git
cd venueScraper
npm install
Create a .env
file in the directory with
YELP_API_KEY=<key>
To get a key, follow the steps here.
Usage
rrrr [options] [files || list...]
Flags:
Flags:
-h, --help show this help message.
-n, --names use venue names instead of yelp-fusion IDs.
--city required with -n, the city the venues are in.
--format how to format output (JSON, CSV, hours).
--outfile file to write to, out.json by default without --city.
Examples:
rrrr infile
Given an infile
of yelp-id
s, will return JSON output matching the Venue
schema.
rrrr --names --city "New Orleans, LA" --format hours infile
Given an infile
of venue names in New Orleans, will return JSON output providing only yelp-id
identifier and opening hours.
Yelp API
The Yelp API imposes some limitations on usage. The scraper performs requests sequentially to avoid triggering the QPS limit and will likely not be impacted by the 5000 requests/day limit assuming moderate use.
Trivia
I came up with the invocation rrrr
at 200.
1.0.0
3 years ago