Tracify

Observability and tracing for AI agents. Gain full visibility into your agent's decision-making process, tool usage, and LLM costs.

Installation

npm install tracify-sdk
# or
yarn add tracify

Quickstart

1. Get your API Key from the Tracify Dashboard.
2. Set it as an environment variable:

export TRACIFY_API_KEY=your_sk_live_...

3. Instrument your agent:

import { traceAgent, llmCall, toolCall } from 'tracify-sdk';

const agent = traceAgent(async (query: string) => {
  // LLM Call
  await llmCall({
    input: query,
    output: "Thinking...",
    modelId: "gpt-4o",
    costUsd: 0.002,
    latencyMs: 800
  });
  
  // Tool Use
  await toolCall({
    toolName: "web_search",
    input: { q: query },
    output: "Found results...",
    latencyMs: 1200
  });
  
  return "Final Answer";
});

Features

• traceAgent Wrapper: Automatically captures run lifecycle and errors.
• Granular Spans: Manually record LLMs, tools, and custom decisions.
• Environment Aware: Automatically picks up API keys from process.env.
• Lightweight: Minimal dependencies, optimized for Node.js and Edge runtimes.
• Session context: Add sessionId, endUserId, environment, release, and tags to connect related traces.

Feedback and evaluation scores

Pass projectId when constructing the client to attach end-user feedback and typed scores to traces:

const client = new TracifyClient({ apiKey: process.env.TRACIFY_API_KEY, projectId: "your-project-id" });
client.feedback(runId, true, { kind: "thumb", comment: "Helpful answer" });
client.score(runId, "answer_quality", 0.92, { dataType: "numeric" });

These helpers use the project API key, deduplicate when given a dedupeKey, and never throw into the agent process.

Prompt deployment

Resolve a deployed prompt without shipping a new application build:

const deployed = await client.getPrompt("support-agent", "production");
await client.ingest({ spanType: "llm", input: question, output, promptVersionId: deployed.version.id });

Prompt responses are cached for 60 seconds by default. Pass { cacheTtlMs: 0, fallback } for development or guaranteed-availability behavior.

License

MIT