AI-Utils: JS/TS toolkit for building AI apps, chatbots and agents

Quick Install | Introduction | Features | Integrations | Examples

Quick Install

npm install --save @lgrammel/ai-utils

Introduction

AI-Utils is a JavaScript/TypeScript AI-focused toolset, built around the principles of functional programming and automatic type inference. AI-utils is designed to be convenient and at the same time transparent and extensible.

It provides utilities that make it easier to use AI-functionality such as text generation and voice transcription, and contains examples to show how to build apps with AI. The utilities include convenience methods to call AI APIs (e.g. OpenAI), helpers to make AI-apps production-grade (e.g. token counting, cost calculation, abort & error handling, progress reporting), and more advanced chains (e.g. split/map/filter/reduce for text processing).

Features

• Text processing chains
  • recursive text mapping (e.g. for summarization or extraction)
  • split-map-filter-reduce for text processing
• Text splitters
  • Recursive character and token splitters
• Tokenization
• Prompt utilities
  • Fit recent messages chat prompt into context window
• Run abstraction for progress reporting and abort signals
• Retry management
• Error handling

Integrations

• OpenAI
  • chat completions (regular, streaming) - GPT-4, GPT-3.5
  • text completions (regular) - Davinci, Curie, Babbage, Ada
  • tokenization (TikToken) and token counting (incl. message and prompt overhead tokens in chat)
  • transcription - Whisper

Examples

PDF to Twitter Thread

terminal app, PDF parsing, split-map-filter-reduce, OpenAI GPT-4

Takes a PDF and a topic and creates a Twitter thread with all content from the PDF that is relevant to the topic.

AI Chat (Next.JS)

Next.js app, OpenAI GPT-3.5-turbo, streaming, stream forwarding (keep API key on server)

A basic web chat with an AI assistant, implemented as a Next.js app.

BabyAGI Classic

terminal app, agent, BabyAGI, OpenAI text-davinci-003

TypeScript implementation of the classic BabyAGI by @yoheinakajima without embeddings.

Voice recording and transcription (Next.js)

Next.js app, OpenAI Whisper,

Record audio with push-to-talk and transcribe it using Whisper, implemented as a Next.js app. The app shows a list of the transcriptions.