Crawler Html 3T

Đây là thư viện dùng để bóc tách dữ liệu html

Installation

npm install crawler-html-3t --save

Usage

Class ModelMongoose

1. mod_sources

• name_index
• SourcesNews
• Articles

2. mod_baogom

• name_index
• mod_acticles
• mod_links
• mod_categories

Class HtmlParser

1. GetHtmlDoc

• body: html

• $: jquery

  GetHtmlDoc(url,function(error, body, $));

Class HtmlExtract

1. getTitle

 var title =  getTitle($);

2. getDesc

 var description =  getDesc($);

3. getImage

 var url_image =  getImage($);

Class ReadRss

1. getListFeed

getListFeed(url_rss,function(error,list_feed));

2. getListFeedByBodyXml

getListFeedByBodyXml(bodyXml,function(error,list_feed));