@twilio-alpha/assistants-eval
v0.1.1
Published
promptfoo extension for writing AI evaluations for Twilio AI Assistants
Downloads
11
Maintainers
Readme
Twilio AI Assistants Evaluation
This repository contains the extentions to the promptfoo.dev framework for test your Twilio AI Assistant.
Installation
- Install and setup
promptfooas described in the promptfoo.dev documentation. - Install this extension using
npm install @twilio-alpha/assistants-eval. - Create a target in your promptfoo config yaml:
targets:
- id: package:@twilio-alpha/assistants-eval:TwilioAgentProvider
label: TwilioProvider
config:
assistantId: aia_asst_abc123
accountSid: ACXXX
authTokenKey: TWILIO_AUTH_TOKENUsage
Consult promptfoo.dev for general usage instructions on how to use promptfoo.
Configuration Options
assistantId: stringThe ID of the Twilio AI Assistant you want to test.accountSid: stringThe Twilio Account SID.authTokenKey: stringThe environment variable key that contains the Twilio Auth Token.sessionId?: stringThe session ID to use for the conversation. If no sessionId is provided a random UUID will be generated.identity?: stringThe identity of the user. Defaults totest-evaluator.
