@dirathea/n8n-nodes-gpt4all
v0.1.0
Published
N8N Node to run GPT4All
Downloads
3
Readme
n8n-nodes-gpt4all
This is an n8n community node. It lets you use self hosted GPT4All in your n8n workflows.
GPT4ALL is an ecosystem of open-source chatbots trained on a massive collections of clean assistant data including code, stories and dialogue.
n8n is a fair-code licensed workflow automation platform.
Installation
Operations
Compatibility
Usage
Resources
Installation
Follow the installation guide in the n8n community nodes documentation.
This node uses GPT4All-ts which by default, will download all necessary files on the first run. It basically downloads the gpt4all
binary and the model (the size is roughly 4GB) if it doesn't found on ~/.nomic
. On docker, the path will be /home/node/.nomic
, and it highly recommended to persist that directory as volume.
ARM Based Deployment (Raspberry PI, Orange PI)
This extensions develop and test using an Orange PI 5 16GB memory, with SSD NVME 256 GB, running Armbian (debian based). The GPT4All doesn't have binary ready for linux with aarch64, and we need to compile it directly on the machine itself.
Compile GPT4All for Linux ARM64
Assuming you're on your docker container, run the following command for build the gpt4all binary. All the steps are taken from the original repo
mkdir /home/node/.nomic
git clone https://github.com/zanussbaum/gpt4all.cpp.git
cd gpt4all.cpp
make
# There will be a binary called `chat`, move it to the /home/node/.nomic with name gpt4all
mv chat ../gpt4all
Operations
GPT4All only expose one main operations: Prompt.
Compatibility
The extension is develop and tested using n8n docker with tag 0.221.3-debian.