llm-ab-tester
v1.0.0
Published
A/B testing framework for LLM prompts with statistical significance testing
Maintainers
Readme
llm-ab-tester
A/B testing for LLM prompts with stats.
Installation
npm install llm-ab-testerUsage
const { ABTest } = require('llm-ab-tester');
const test = new ABTest('my-test');
test.addVariant('A', 'prompt v1').addVariant('B', 'prompt v2');
const variant = test.select();
test.record(variant.name, 0.85);
console.log(test.report());License
MIT
