@braintrust/opencode-plugin

Braintrust integration plugin for OpenCode. Provides automatic session tracing and data access tools for your Braintrust workspace.

Features

1. Automatic Session Tracing

Traces your OpenCode sessions to Braintrust with hierarchical spans:

• Session spans: Root span for each OpenCode session with metadata (workspace, hostname, etc.)
• Turn spans: Captures each user-assistant interaction
• Tool spans: Records individual tool executions with inputs and outputs

2. Braintrust Data Access Tools

Custom tools available to the AI assistant:

• braintrust_query_logs: Execute SQL queries against your Braintrust logs
• braintrust_list_projects: List all projects in your organization
• braintrust_log_data: Manually log data for evaluation or tracking
• braintrust_get_experiments: View recent experiments

Quick Start

Add to your OpenCode configuration (opencode.json or ~/.config/opencode/opencode.json):

{
  "plugin": ["@braintrust/opencode-plugin"]
}

Then,

# Set your API key
export BRAINTRUST_API_KEY="your-api-key"
export TRACE_TO_BRAINTRUST="true"

# Run OpenCode
opencode

# View traces at:
# https://www.braintrust.dev/app/projects/opencode/logs

Configuration

You can configure the plugin using a config file or environment variables.

Config File

Create a braintrust.json file in one of these locations:

• .opencode/braintrust.json - Project-level config
• ~/.config/opencode/braintrust.json - Global config

{
  "trace_to_braintrust": true,
  "project": "my-project",
  "api_key": "your-api-key",
  "debug": true
}

Config Options

| Config Key | Env Var | Type | Default | Description | |------------|---------|------|---------|-------------| | trace_to_braintrust | TRACE_TO_BRAINTRUST | boolean | false | Enable/disable tracing | | project | BRAINTRUST_PROJECT | string | "opencode" | Project name for traces | | debug | BRAINTRUST_DEBUG | boolean | false | Enable debug logging | | api_key | BRAINTRUST_API_KEY | string | | API key for authentication | | api_url | BRAINTRUST_API_URL | string | "https://api.braintrust.dev" | API URL | | app_url | BRAINTRUST_APP_URL | string | "https://www.braintrust.dev" | App URL | | org_name | BRAINTRUST_ORG_NAME | string | | Organization name |

Precedence

Configuration is loaded with the following precedence (later overrides earlier):

1. Default values
2. ~/.config/opencode/braintrust.json (global config)
3. .opencode/braintrust.json (project config)
4. Environment variables (highest priority)

Usage

Viewing Traces

Once configured, your OpenCode sessions will automatically appear in your Braintrust project. Visit:

https://www.braintrust.dev/app/projects/<your-project>/logs

Using Data Access Tools

The AI assistant can use Braintrust tools directly:

Query logs:

Can you show me the last 10 logs from Braintrust?

Log data for evaluation:

Log this output to Braintrust with a score of 0.9 for accuracy

List projects:

What Braintrust projects do I have access to?

SQL Query Examples

The braintrust_query_logs tool supports Braintrust's SQL dialect:

-- Recent logs
SELECT * FROM logs ORDER BY created DESC LIMIT 10

-- Logs with low scores
SELECT * FROM logs WHERE scores.Factuality < 0.5

-- Logs from the last hour
SELECT * FROM logs WHERE created > now() - interval 1 hour

-- Search by metadata
SELECT * FROM logs WHERE metadata.task_type = 'code_review'

Trace Structure

Sessions are traced with the following hierarchy:

Session (task span)
├── metadata: session_id, workspace, hostname, username, os
├── Turn 1 (task span)
│   ├── input: "user message"
│   ├── metadata: turn_number, agent, model
│   ├── Tool 1 (tool span)
│   │   ├── input: tool arguments
│   │   └── output: tool result
│   └── Tool 2 (tool span)
├── Turn 2 (task span)
│   └── ...
└── metrics: total_turns, total_tool_calls

Troubleshooting

Plugin not loading / class constructor error

If you see an error like Cannot call a class constructor without |new|:

1. Make sure you're using the latest build:

   cd /path/to/braintrust-opencode-plugin
   bun run build
   cp dist/index.js ~/.config/opencode/plugin/braintrust.js

2. Or reinstall using the install script:

   ./install.sh

No traces appearing in Braintrust

1. Check that your API key is set:

   echo $BRAINTRUST_API_KEY

2. Enable debug mode to see what's happening:

   export BRAINTRUST_DEBUG=true
   opencode

3. Check OpenCode logs for errors

4. Verify the plugin is loaded:

   • Plugin should log "Braintrust plugin initialized" when OpenCode starts

Tools not working

If the Braintrust tools aren't available to the AI:

1. Make sure BRAINTRUST_API_KEY is set
2. Check that the plugin loaded successfully
3. Try asking: "What tools do you have access to?"

API connection errors

If you see connection errors:

1. Check your internet connection
2. Verify your API key is valid at https://www.braintrust.dev/app/settings
3. Check if there's a firewall blocking api.braintrust.dev

Development

# Install dependencies
bun install

# Build
bun run build

# Type check
bun run typecheck

# Run locally with OpenCode
opencode --plugin-dir ./dist

API Reference

BraintrustPlugin

The main plugin export. Automatically initializes when OpenCode loads.

BraintrustClient

Low-level client for Braintrust API:

import { BraintrustClient, loadConfig } from "opencode-braintrust"

const client = new BraintrustClient(loadConfig())
await client.initialize()

// Insert a span
await client.insertSpan({
  id: "...",
  span_id: "...",
  root_span_id: "...",
  input: "...",
  output: "...",
})

// Query logs
const results = await client.queryLogs("SELECT * FROM logs LIMIT 10")

License

MIT

Related

• Braintrust - AI evaluation and observability platform
• OpenCode - AI-powered coding assistant
• braintrust-skill - Similar plugin for Claude Code