1.0.12 • Published 5 years ago

ctripcrawler v1.0.12

Weekly downloads
3
License
MIT
Repository
github
Last release
5 years ago

CtripCrawler

scrape ticket data from ctrip.com

This module can help you to collect data about ticket availability and prices in China. This version is for collecting ticket data in bulk and or task scheduling.

https://github.com/mrfinster100

#Help

CtripCrawler

  -crawl .............. crawl a page
  -version ............ show package version
  -help ............... show help menu for a command

  -S ................. enter crawler settings`

Note: Change your font to NSimSun to view Chinese characters in the terminal. (open NodeJS > click top left corner > Properties > Font > NSimSun)

#Settings

Settings

  -startdate .......... modify start date
  -pages .............. modify # of pages to scrape
  -origins ............ edit origin cities list
  -destinations ....... edit destination cities list
  -headless ........... toggle headless setting on/off
  -slowmo ............. adjust speed of scraper
  -automate............ schedule automated scraping

  -crawl ............. initiate crawler

example

$node ctripcrawler -S

install

With npm do:

$ cd ctripcrawler
$ npm install
$ npm link
$ which ctripcrawler
$ ctripcrawler

license

MIT

1.0.12

5 years ago

1.0.11

5 years ago

1.0.10

5 years ago

1.0.9

5 years ago

1.0.8

5 years ago

1.0.7

5 years ago

1.0.6

5 years ago

1.0.5

5 years ago

1.0.4

5 years ago

1.0.3

5 years ago

1.0.2

5 years ago

1.0.1

5 years ago

1.0.0

5 years ago