Adversaria Node.js SDK

Node.js bindings for Adversaria - Adversarial Testing Harness for LLMs.

Installation

npm install adversaria
# or
yarn add adversaria

Quick Start

const { Adversaria } = require('adversaria');

async function main() {
  const client = new Adversaria();
  
  const result = await client.run({
    provider: 'openai',
    model: 'gpt-4',
    suites: ['prompt_injection', 'jailbreak'],
    apiKey: process.env.OPENAI_API_KEY
  });
  
  console.log(`Risk Score: ${result.riskScore}/100`);
  console.log(`Successful: ${result.successfulAttacks}/${result.totalAttacks}`);
}

main().catch(console.error);

TypeScript Support

import { Adversaria, TestResult, RunOptions } from 'adversaria';

async function runTests(): Promise<TestResult> {
  const client = new Adversaria();
  
  const options: RunOptions = {
    provider: 'openai',
    model: 'gpt-4',
    apiKey: process.env.OPENAI_API_KEY
  };
  
  return await client.run(options);
}

API

new Adversaria(configPath?)

Create a new Adversaria client.

• configPath (optional): Path to configuration file

client.run(options)

Run security tests against an LLM.

Options:

• provider: Provider name ('openai', 'anthropic', 'ollama')
• model: Model name
• suites (optional): Array of suite IDs to run
• apiKey (optional): API key (uses env var if not provided)

Returns: Promise<TestResult>

client.listSuites()

List available attack suites.

Returns: Array<Suite>

getVersion()

Get the version of the Adversaria library.

Returns: string

Examples

Basic Usage

const { Adversaria } = require('adversaria');

const client = new Adversaria();

client.run({
  provider: 'openai',
  model: 'gpt-4'
}).then(result => {
  console.log(`Risk: ${result.riskScore}/100`);
});

List Suites

const suites = client.listSuites();
suites.forEach(suite => {
  console.log(`${suite.id}: ${suite.name} (${suite.payloadCount} payloads)`);
});

Multiple Providers

const providers = [
  { provider: 'openai', model: 'gpt-4' },
  { provider: 'anthropic', model: 'claude-3-opus-20240229' }
];

for (const config of providers) {
  const result = await client.run(config);
  console.log(`${config.provider}/${config.model}: ${result.riskScore}/100`);
}

License

MIT