@kognitivedev/voice

OpenAI Realtime voice agents for Kognitive.

Installation

bun add @kognitivedev/voice @kognitivedev/tools

What It Provides

• createVoiceAgent()
• issueRealtimeClientSecret()
• createBrowserVoiceSession()

Example

import { createVoiceAgent, createBrowserVoiceSession } from "@kognitivedev/voice";
import { createTool } from "@kognitivedev/tools";
import { z } from "zod";

const weatherTool = createTool({
  id: "weather-lookup",
  description: "Look up weather",
  inputSchema: z.object({ city: z.string() }),
  execute: async ({ city }) => ({ city, temperature: 24 }),
});

const voiceAgent = createVoiceAgent({
  name: "voice-assistant",
  instructions: "Help the user in a concise spoken style.",
  tools: [weatherTool],
});

const prepared = await voiceAgent.prepare({
  resourceId: { userId: "user_1" },
});

const session = createBrowserVoiceSession({
  prepare: prepared,
  clientSecretEndpoint: "/api/kognitive/voice/agents/voice-assistant/client-secret",
  toolEndpoint: "/api/kognitive/voice/agents/voice-assistant/tools/execute",
});

await session.connect();
session.sendText("What is the weather in Paris?");

VoiceSessionState.messages uses KognitiveUIMessage[], so existing @kognitivedev/ui tool registrations can render voice tool calls and results without a second registry.