1.0.12 • Published 5 years ago
ctripcrawler v1.0.12
CtripCrawler
scrape ticket data from ctrip.com
This module can help you to collect data about ticket availability and prices in China. This version is for collecting ticket data in bulk and or task scheduling.
https://github.com/mrfinster100
#Help
CtripCrawler
-crawl .............. crawl a page
-version ............ show package version
-help ............... show help menu for a command
-S ................. enter crawler settings`
Note: Change your font to NSimSun to view Chinese characters in the terminal. (open NodeJS > click top left corner > Properties > Font > NSimSun)
#Settings
Settings
-startdate .......... modify start date
-pages .............. modify # of pages to scrape
-origins ............ edit origin cities list
-destinations ....... edit destination cities list
-headless ........... toggle headless setting on/off
-slowmo ............. adjust speed of scraper
-automate............ schedule automated scraping
-crawl ............. initiate crawler
example
$node ctripcrawler -S
install
With npm do:
$ cd ctripcrawler
$ npm install
$ npm link
$ which ctripcrawler
$ ctripcrawler
license
MIT