product-hunt-scraper
v1.0.6
Published
<div align="center"> <strong>Scrape and extract detailed data from Product Hunt with ease.</strong> </div> <div align="center"> Designed to work seamlessly in Node.js environments, providing detailed product information including comments. </div>
Downloads
14
Maintainers
Readme
Overview
The Product Hunt Scraper allows you to scrape product listings from Product Hunt, capturing details like name, description, upvotes, comments, and more. The scraper uses Puppeteer and Cheerio to fetch and parse data, and outputs the data to a CSV file.
Features
✨ Efficient: Uses Puppeteer to simulate browser behavior, ensuring all dynamic content is loaded.
🛠 Real-time Output: Writes data to a CSV file incrementally, allowing you to monitor progress.
🔍 Comprehensive Data: Captures detailed product information, including all comments.
Installation
Install the scraper using npm:
npm install product-hunt-scraper
Usage
To use the scraper, run:
npx product-hunt-scraper <number_of_scrolls> <output_file>
Parameters
Number of Scrolls: Determines how many times the scraper will scroll down to load more data. This helps in fetching more entries from Product Hunt.
File Path: Specifies the path of the CSV file where the scraped data will be saved.
Example:
npx product-hunt-scraper 5 output.csv
Default number of scrolls: 10
Default output file: product_hunt_products.csv