SpiderCheck
basic web crawler
var spider = new SpiderCheck()
Events
- 'error' - (error)
- 'crawl' - (statusCode, url, res)
spider.addURL(url)
add a URL to the crawl queue
spider._crawl()
start crawling
basic web crawler
add a URL to the crawl queue
start crawling
npm i spidercheck
1
0.0.0
MIT