nodecrawlercnwallstreet v1.0.0

node-crawler-cn-Wallstreet

A node crawler using cheerio & nightmare to scrape the news & the article of news from wallstreetcn, and save the data to json file.

Installation

npm install node-crawler-cn-wallstreet

Usage

node index.js

Specify:
newstype: global,shares,bonds,commodities,forex,enterprise,economy,charts,china,us,europe,japan
numOfRecord: 5

node index.js forex 10

Dev mode to show the log .

DEBUG=nightmare node index.js forex 10

Then it will save json file to /output.