npm package discovery and stats viewer.

Discover Tips

  • General search

    [free text search, go nuts!]

  • Package details

    pkg:[package-name]

  • User packages

    @[username]

Sponsor

Optimize Toolset

I’ve always been into building performant and accessible sites, but lately I’ve been taking it extremely seriously. So much so that I’ve been building a tool to help me optimize and monitor the sites that I build to make sure that I’m making an attempt to offer the best experience to those who visit them. If you’re into performant, accessible and SEO friendly sites, you might like it too! You can check it out at Optimize Toolset.

About

Hi, 👋, I’m Ryan Hefner  and I built this site for me, and you! The goal of this site was to provide an easy way for me to check the stats on my npm packages, both for prioritizing issues and updates, and to give me a little kick in the pants to keep up on stuff.

As I was building it, I realized that I was actually using the tool to build the tool, and figured I might as well put this out there and hopefully others will find it to be a fast and useful way to search and browse npm packages as I have.

If you’re interested in other things I’m working on, follow me on Twitter or check out the open source projects I’ve been publishing on GitHub.

I am also working on a Twitter bot for this site to tweet the most popular, newest, random packages from npm. Please follow that account now and it will start sending out packages soon–ish.

Open Software & Tools

This site wouldn’t be possible without the immense generosity and tireless efforts from the people who make contributions to the world and share their work via open source initiatives. Thank you 🙏

© 2024 – Pkg Stats / Ryan Hefner

n8n-nodes-firecrawl

v0.3.0

Published

FireCrawl nodes for n8n

Downloads

618

Vulnerabilities

Powered byPowered by Snyk
  • 0High
  • 0Medium
  • 0Low

Links

Git

Maintainers

minhlucvanminhlucvan

Keywords

n8n-community-node-packagefirecrawln8n

Readme

n8n-nodes-firecrawl

This is an n8n community node. it lets you use Firecrawl in your n8n workflows.

Firecrawl is a web scraping tool that allows you to extract data from websites and APIs.

https://www.firecrawl.dev/

n8n is a fair-code licensed workflow automation platform.

Installation
Operations
Credentials
Compatibility
Usage Resources

Installation

Follow the installation guide in the n8n community nodes documentation.

Operations

Scrape

Firecrawl converts web pages into markdown, ideal for LLM applications.

  • It manages complexities: proxies, caching, rate limits, js-blocked content
  • Handles dynamic content: dynamic websites, js-rendered sites, PDFs, images
  • Outputs clean markdown, structured data, screenshots or html.

Crawl

Firecrawl can recursively search through a urls subdomains, and gather the content

  • Firecrawl thoroughly crawls websites, ensuring comprehensive data extraction while bypassing any web blocker mechanisms. Here’s how it works:

  • URL Analysis: Begins with a specified URL, identifying links by looking at the sitemap and then crawling the website. If no sitemap is found, it will crawl the website following the links.

  • Recursive Traversal: Recursively follows each link to uncover all subpages.

  • Content Scraping: Gathers content from every visited page while handling any complexities like JavaScript rendering or rate limits.

  • Result Compilation: Converts collected data into clean markdown or structured output, perfect for LLM processing or any other task.

This method guarantees an exhaustive crawl and data collection from any starting URL.

Map

The easiest way to go from a single url to a map of the entire website. This is extremely useful for:

  • When you need to prompt the end-user to choose which links to scrape
  • Need to quickly know the links on a website
  • Need to scrape pages of a website that are related to a specific topic (use the search parameter)
  • Only need to scrape specific pages of a website

Credentials

FireCrawl API

The FireCrawl API is the only authentication method available for this node. You can find your API key in the FireCrawl dashboard.

Compatibility

This node has been tested with the following versions of N8N.

  • N8N 1.57.0

Usage

  • Install the Firecrawl node
  • Enter your Firecrawl API key
  • Choose the operation you want to perform

Resources