@twilio-alpha/assistants-eval
v0.0.2
Published
promptfoo extension for writing AI evaluations for Twilio AI Assistants
Downloads
0
Maintainers
Readme
Twilio AI Assistants Evaluation
This repository contains the extentions to the promptfoo.dev framework for test your Twilio AI Assistant.
Installation
- Install and setup
promptfoo
as described in the promptfoo.dev documentation. - Install this extension using
npm install @twilio-alpha/assistants-eval
. - Create a target in your promptfoo config yaml:
targets:
- id: package:@twilio-alpha/assistants-eval:TwilioAgentProvider
label: TwilioProvider
config:
assistantId: aia_asst_abc123
accountSid: ACXXX
authTokenKey: TWILIO_AUTH_TOKEN
Usage
Consult promptfoo.dev for general usage instructions on how to use promptfoo.
Configuration Options
assistantId: string
The ID of the Twilio AI Assistant you want to test.accountSid: string
The Twilio Account SID.authTokenKey: string
The environment variable key that contains the Twilio Auth Token.sessionId?: string
The session ID to use for the conversation. If no sessionId is provided a random UUID will be generated.identity?: string
The identity of the user. Defaults totest-evaluator
.