web-scrappy
v0.1.0
Published
Yet another web scraper.
Downloads
5
Readme
web-scrappy
web-scrappy
Yet another web scraper, get a site, make a config and get data!
Install
npm install -g web-scrappy
Usage
scrappy <url> <configFile> [outFile]
Example url -> https://wltest.dns-systems.net/ Example config here
Developing
Get up and running with web-scrappy on your local machine.
Prerequisites
- Node: Version 19 or higher
Installing
- Clone the repository (or fork it)
git clone https://github.com/edkotkas/web-scrappy.git && cd web-scrappy
- Install the dev dependencies
npm i
- Run the script
npm start -- <url> <configFile> [outFile]
- Add issues to Github, make changes to the project and create pull requests for review
Tests
Run the tests
npm test
License
ISC © Eduard Kotkas