Ogov-importer NPM

ogov-importer

Argentina's Congress data importer. It imports the following data:

Bills
Committees
People (legislatives and senators)
Votes
Events

Datasets are available in ogov-data project.

The data format is described in the model documentation. In order to understand how importers work, look at the crawler documentation.

Installation

  npm install -g ogov-importer

Usage

Importer data is stored into the data directory created in current working directory.

Formal command line parameters:

$ ogov-importer bills|committees|people|votes|events
  [--historyEnabled=true] [--cacheEnabled=false] [--start=1999] [--end=2015]
  [--pageSize=1000] [--poolSize=4] [--startPage=0]

Import bills:

$ ogov-importer bills

Import committees:

$ ogov-importer committees

Import people:

$ ogov-importer people

Import votes:

$ ogov-importer votes

Import events:

$ ogov-importer events

It is possible to run multiple importers at the same time:

$ ogov-importer committees people votes

Parameters

The following parameters are supported by all importers:

--historyEnabled=true|false. Default is true. Enables the history to generate a delta file with changes since the previous execution. It causes the history to read the previous dataset file.

--cacheEnabled=true|false. Default is false. When enabled, all data is read from the file system cache if available. It is intented for debugging purposes.

The bill importer supports the following additional parameters:

--start=YEAR. Default is 1999. Year to start importing bills from.

--end=YEAR. Default is the current year. Year to end importing bills.

--startPage=NUMBER. Default is 0. 0-based page to start importing data. The number of pages depends on the pageSize parameter. It is intented for debugging purposes.

--pageSize=NUMBER. Default is 1000. How many bills will retrieve in a single result page. It is intented for debugging purposes.