2.1.5 • Published 1 year ago
xw-spikingss v2.1.5
Spiking
Chinese | English
A common web crawler tool developed using Node.js.
Advantage
- Graphical Interface (Electron)
- Custom initial link
- Headless browser support (puppeteer)
- Concurrent / multithreaded
- Efficient crawling mechanism
- Automatic similarity
- Progress visualization
- Using a proxy
Getting started
git clone https://github.com/Xciyang/spiking.git
cd spiking
npm install
npm start
Usage
Download the latest Release version.
Please read usage: English(en_US)
To-do list
- Localization
- Tasks Saving
- Custom filtering method