web-scrappy v0.1.0

web-scrappy

web-scrappy

Yet another web scraper, get a site, make a config and get data!

Install

npm install -g web-scrappy

Usage

scrappy <url> <configFile> [outFile]

Example url -> https://wltest.dns-systems.net/ Example config here

Developing

Get up and running with web-scrappy on your local machine.

Prerequisites

• Node: Version 19 or higher

Installing

• Clone the repository (or fork it)

git clone https://github.com/edkotkas/web-scrappy.git && cd web-scrappy

• Install the dev dependencies

npm i

• Run the script

npm start -- <url> <configFile> [outFile]

• Add issues to Github, make changes to the project and create pull requests for review

Tests

Run the tests

npm test

License

ISC © Eduard Kotkas