krawala
v0.1.2
Published
Simple javascript web-crawler with command line interface
Downloads
1
Readme
Krawala
Simple javascript web-crawler with command line interface
Install
Run the following to install as a global CLI
npm i krawala -g
Usage
Usage: krawala crawl [options]
Options:
--help, -h Display help and usage info
--depth, -d Depth to crawl [number]
--format, -f Format to return [string]
--interval, -i Interval between requests (millis) [number]
--timeout, -t Maximum time to wait for a request (millis) [number]
--url, -u URL to crawl [string]
Examples:
krawala crawl -u http://domain.com -d 100