scrapemate
v1.0.0
Published
Easy web scraper
Downloads
1
Readme
ScrapeMate
Easy web scraper.
Installation
ScrapeMate is available as open source node package to all developers to use in projects.
It can be installed by running the following node command:
npm install ScrapeMate --save
Description
ScrapeMate can be used to scrape different HTML tags and links from any webpage by passing on URL of the target and other optional parameters. It primarily consists of the following functions - getTags(url) - To get a list of all the tags used in the HTML code of a target webpage located in the passed on URL. getLinks(url) - Used to obtain all the links placed in the target webpage located in the passed on URL. getTagItem(url,tag) - Used to obtain all the tags passed on to the function present in the target webpage located in the passed on URL.
Usage
Example for getTags(url)
let uri = 'https://google.com';
getTags(uri).then(res => {
var result = res;
console.log(result);
});
Example for getLinks(url)
let uri = 'https://google.com';
getLinks(uri).then(res => {
console.log(res);
console.log(res.length);
});
Example for getTagItem(uri,tag)
let uri = 'https://google.com';
let tag = 'div';
getTagItem(uri, tag).then (res => {
console.log(res);
console.log(res.length);
});