poor_crawler
v0.1.0
Published
simple program to fetch urls
Downloads
6
Readme
poor_crawler - simple crawler
How to use :
var Crawler = require('./crawler.js');
var myCrawler = new Crawler();
myCrawler.extractFromUrl("http://myPage.com");where "http://myPage.com" is the startup point. You can try it by typing :
node test.jsThe result are not stored anywhere but in the console, and the program will brake when the array stocking the visited adress is full.
