❤
npm
Sign UpSign In

mixed-content-crawler

0.1.0 • Public • Published

mixed-content-crawler NPM version Build Status Dependency Status Coverage percentage

Find mixed content errors on a site by crawling it with Puppeteer

Installation

$ npm install mixed-content-crawler

CLI Demo

mixed-content-crawler demo

CLI Usage

$ mixed-content-crawler
 
  Find mixed content errors on a site by crawling it with Puppeteer
 
  Usage
 
    $ mixed-content-crawler <url>
 
  Example
 
    $ mixed-content-crawler https://buster.neocities.org/crwlr/
 
$ mixed-content-crawler https://buster.neocities.org/crwlr/
resolved: 200 https://buster.neocities.org/crwlr/
resolved: 200 https://buster.neocities.org/crwlr/other.html
blocked-mixed-content: http://http.badssl.com/icons/icon-red.png
resolved: 200 https://buster.neocities.org/crwlr/mixed-content.html
resolved: 404 https://buster.neocities.org/crwlr/missing.html
requestfailed: https://buster.neocities.org/crwlr/dummy.pdf {"errorText":"net::ERR_ABORTED"}

Module Usage

const mixedContentCrawler = require('mixed-content-crawler');
 
const results = await mixedContentCrawler('https://buster.neocities.org/crwlr/');
results.forEach((mixedRequests, page) => {
  console.log(page);
  for (let r of mixedRequests) {
    console.log('->', r);
  }
});
// https://buster.neocities.org/crwlr/mixed-content.html
// -> http://http.badssl.com/icons/icon-red.png

TODO

  • [] Allow for ignoring location.hash when determinining unique URLs
  • [] Better documentation

License

ISC © Buster Collings

Readme

Keywords

Package Sidebar

Install

npm i mixed-content-crawler

Repository

github.com/busterc/mixed-content-crawler

Homepage

github.com/busterc/mixed-content-crawler#readme

Weekly Downloads

0

Version

0.1.0

License

ISC

Unpacked Size

7.97 kB

Total Files

6

Last publish

Collaborators

  • buster
Try on RunKit
Report malware