sitescrapr
v0.0.1
Published
Simple website crawler and scraper
Downloads
16
Maintainers
Readme
sitescrapr
Simple website crawler and content scraper.
Author
About
The purpose of sitescrapr is to provide a framework to scrape content from a particular website.
Most sitescrapr projects will follow this pattern:
- Get "search results/listings"
- Parse "search results/listings" and save "item links"
- Get all "items" from "item links"
- Parse all "items"
- Save all "items"
Usage
Please see sitescrapr-example for more documentation and working example.
$ npm install sitescrapr
History
0.0.1
- Initial sitescrapr implementation.
License
(The MIT License)