mrspider-request
v2.2.1
Published
transform stream for mrspider
Maintainers
Readme
mrspider-request
Middleware for mrspider typically the first middleware setting the content and response properties of the page. So in further middlewares the downloaded contents are available via page.content and response via page.response.
Install
npm i -S mrspider-request
Usage
var spider = require('mrspider');
var spiderRequest = require('mrspider-request');
spider.use(spiderRequest);