squirrelbot
v1.0.0
Published
CLI utility to crawl web servers, cache HTML documents, and query them with CSS selectors.
Downloads
4
Maintainers
Readme
squirrelbot
Command-line utility that can crawl a web server recursively, cache a collection of HTML responses, and query them using CSS selectors.
Command-Line Usage
node sqrl create CACHEFILE ENTRYPOINT
to create a cache file by crawling from entrypoint
node sqrl list CACHEFILE
to list the URL's in the cache file
node sqrl query CACHEFILE SELECTOR
to query the HTML documents in the cache file by the CSS selector