consolecrawler
v0.0.5
Published
Crawls a given website using PhantomJS - and logging any console errors
Downloads
1
Readme
PhantomJS Console Crawler
This crawler will scan a website for links, follow them, then report back any javascript console errors.
Useful for javascript heavy websites to check updates have not caused any JS errors.
Requirements
- Currently this only works on unix systems
- You need to have
pkill
installed, try typingwhich pkill
, if not you can trybrew install pkill
Installation
You can easily install the package via npm npm install consolecrawler -g
As long as your NPM modules is in your $PATH you should be able to run
consolecrawler
from your command line.
Usage
Usage: consolecrawler [options]
Crawls a given website using PhantomJS - and logging any console errors
Options:
-h, --help output usage information
-V, --version output the version number
-u, --url <string> Define the URL you want to crawl
-m, --max <n> Defines max pages to scan (defaults to 25)
-i, --id <string> Defines the ID of a scan, useful for debugging logs
-l, --log Writes the raw output to file
-v, --verbose Gives more verbose logging messages
Notes
- For each webpage crawled, a new process gets created on the machine, these should get cleaned up after shutting down, but if they don't you can run
pkill -f phantomjs
- Your computer may take off into space.