crawler-toolbox
v1.9.0
Published
crawler toolbox
Readme
Intro
a common crawler for webpages
Feature
- cache support (persistent with sqlite default on
/$homedir/crawler.db) - markdown support
- dom operation support (cheerio)
Dev Setup
yarn
yarn startTest
yarn testProject generated by gengjiawen/ts-scaffold
