2.1.5 • Published 1 year ago

xw-spikingss v2.1.5

Weekly downloads
-
License
MPL-2.0
Repository
github
Last release
1 year ago

Spiking

Chinese | English

npm.io npm.io npm.io npm.io npm.io npm.io npm.io npm.io

A common web crawler tool developed using Node.js.

Advantage

  • Graphical Interface (Electron)
  • Custom initial link
  • Headless browser support (puppeteer)
  • Concurrent / multithreaded
  • Efficient crawling mechanism
  • Automatic similarity
  • Progress visualization
  • Using a proxy

Getting started

git clone https://github.com/Xciyang/spiking.git

cd spiking

npm install

npm start

Usage

Download the latest Release version.

Please read usage: English(en_US)

To-do list

  • Localization
  • Tasks Saving
  • Custom filtering method

More

Electron

puppeteer