Ced-importer-smart-extraction NPM

Overview

The purpose of this repo is to produce a docker image named ced-venueselector

The docker image

Input

The data that you need to input to the image can be ENV variables or arguments, the arguments are directly passed to the script. If you run simply

docker run retailosdev/ced-venueselector

you'll get the help of the script showing which parameters you have to use

The ENV variables accepted by the script are different than the parameters:

PGUSER
PGHOST
PGDATABASE
OLDEST_DATE

Output

The script will produce the following files :

facebook.json : An array of Facebook pages
instagram.json : An array of Instagram pages
twitter.json
foursquare.json
tripadvisor.json
tripadvisor.json
result.json : An array of all the venues, containing all the data in the DB plus an extra field with the lastImport of each social network

Installing

You just need Docker, then everything will be run inside the docker image, don't run directly the node code.

Executing

To execute the script run:

./run.sh volume_id $(heroku config:get DB_URI --app novus-staging) true

The script will exit with status 0 and the complete log will be saved in a file called venue-selector.log. In case the script report an error, it will exit with status 1 and with a complete log from the container.

Testing

To test that everything works simply run:

./run-test.sh

You will find the reports of the test in the test_results folder.