LLMWise TypeScript SDK

Lightweight TypeScript client for the LLMWise multi-model API:

• Chat (single model + Auto routing)
• Failover routing (primary + fallback chain)
• Compare (run 2+ models in parallel)
• Blend (synthesize answers from multiple models, supports MoA / Self-MoA)
• Judge (model-vs-model evaluation)
• Full API coverage for conversations, history, credits, usage, keys, memory, optimization, and settings.

No heavy dependencies. Works in Node 18+ and modern browsers.

Install

npm install llmwise

Quickstart (Chat)

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

const resp = await client.chat({
  model: "auto",
  messages: [{ role: "user", content: "Write a haiku about failover." }],
});

console.log(resp.content);

Streaming (Chat)

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

for await (const ev of client.chatStream({
  model: "claude-sonnet-4.5",
  messages: [{ role: "user", content: "Explain recursion to a 10-year-old." }],
})) {
  if (ev.event === "done") {
    console.log("\\nDONE", ev.credits_charged, ev.credits_remaining);
    break;
  }
  if (ev.delta) process.stdout.write(ev.delta);
}

Failover (Chat + Routing)

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

for await (const ev of client.chatStream({
  model: "claude-sonnet-4.5",
  routing: { fallback: ["gpt-5.2", "gemini-3-flash"], strategy: "rate-limit" },
  messages: [{ role: "user", content: "Summarize this in 3 bullets: ..." }],
})) {
  if (ev.event === "route" || ev.event === "trace") continue;
  if (ev.event === "done") break;
  if (ev.delta) process.stdout.write(ev.delta);
}

Additional API Helpers

• conversations(), getConversation(), createConversation(), updateConversation(), deleteConversation()
• history(), getHistoryDetail()
• creditsWallet(), creditsTransactions(), creditsPacks(), creditsPurchase(), creditsConfirmCheckout(), creditsAutoTopup(), creditsBalance()
• usageSummary(), usageRecent()
• keysInfo(), keysGenerate(), revokeApiKey()
• memory(), memorySearch(), memoryDelete(), memoryClear()
• optimization* helpers, including policy/report/evaluate/replay/test suites/regression schedules
• settings* helpers, including provider keys, privacy, and copilot state/ask endpoints

Additional API Helper Examples

Dashboard/API Health Check (Read-only)

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

const models = await client.models();
const balance = await client.creditsBalance();
const usage = await client.usageSummary({ days: 7 });
const conversations = await client.conversations({ limit: 5 });

console.log({ models: models.length, balance, usage, conversations_count: (conversations as any)?.total || 0 });

Conversation Lifecycle

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

const { id } = await client.createConversation();
await client.updateConversation(id, { title: "API smoke room" });
const list = await client.conversations({ limit: 10 });
await client.deleteConversation(id);

console.log("recent_conversations:", (list as any)?.total ?? 0);

Credits & Cost

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

const wallet = await client.creditsWallet();
const usageRecent = await client.usageRecent({ days: 7, limit: 5 });
const packs = await client.creditsPacks();

console.log({ wallet, usageRecent, packs_count: (packs as any[])?.length });

Settings and Optimization

import { LLMWise } from "llmwise";

const client = new LLMWise("mm_sk_...");

const policy = await client.optimizationPolicy();
const report = await client.optimizationReport({ days: 1, goal: "balanced" });

console.log({ policy, report });

Smoke Script

LLMWISE_API_KEY=mm_sk_... npm run smoke

Configure

• Default base URL: https://llmwise.ai/api/v1
• Override with: new LLMWise({ apiKey, baseUrl })