@aws/genai-plugin-langgraph-agent-for-backstage
v0.1.0
Published
LangGraph agent module package for the GenAI AWS plugins for Backstage
Downloads
99
Readme
Generative AI plugin for Backstage - LangGraph Agent Type
This package implements an agent for the Generative AI plugin for Backstage based on LangGraph.js.
Features:
- ReAct pattern to use available tools to answer prompts
- Choose between Amazon Bedrock or OpenAI as the model provider
- Integrate with LangFuse for observability
Limitations:
- In-memory persistence only: Chat sessions only persist in-memory
Configuration
This agent can be configured at two different levels, global and per-agent
Global
Global configuration values apply to all agents, all of this is optional:
genai:
langgraph:
langfuse: # (Optional) Configuration for LangFuse observability
baseUrl: http://localhost:3001 # (Required) LangFuse URL
publicKey: pk-aaa # (Required) Public key
secretKey: sk-bbb # (Required) Secret key
Per-agent
Per-agent configuration only applies to the agent for which it corresponds. The available parameters are:
genai:
agents:
general:
description: [...]
prompt: [...]
langgraph:
messagesMaxTokens: 100000 # (Required) Prune message history to maximum of this number of tokens
temperature: 0 # (Optional) Model temperature
maxTokens: 4000 # (Optional) Maximum output tokens
topP: 0.9 # (Optional) Model topP
# Only include the subsequent section for your model provider
# Bedrock only
bedrock:
modelId: 'anthropic.claude-3-5-sonnet-20241022-v2:0' # (Required) Bedrock model ID
region: us-west-2 # (Required) Bedrock AWS region
# OpenAI only
openai:
apiKey: ${OPENAI_API_KEY} # (Required) OpenAI model name
modelName: 'gpt-3.5-turbo-instruct' # (Optional) OpenAI model name