csplib-crawler v0.0.1

CSPLibCrawler

This library crawls CSPLib page, downloads all the data of problems and saves them into DokuWiki installation (along with some semantic annotations).

Installation

Npm

$ npm install -g csplib-crawler

Manual installation

$ git clone https://github.com/michalkurzeja/CSPLibCrawler.git
$ npm install

Configuration

The library requires the host name and the path to the media directory of the local DokuWiki installation. You must provide the parameter in params.json file, found in the installation directory: config/params.json.

Usage

Npm installation

Simply run the command:

$ csplib-crawler [--user] [--password]

Manual installation

Run in project directory:

$ node bin/crawl.js [--user] [--password]

Options

You can override any parameter from params.json file via cli-interface, e.g.:

$ csplib-crawler --dokuwiki.host=http://my-dokuwiki-host.com/

This will override the default host and cause the crawler to upload the CSPLib content to http://my-dokuwiki-host.com/