promptly-sdk

Official Node.js/TypeScript SDK for Promptly - LLM cost optimization proxy.

Install

npm install promptly-sdk

Quick Start

import Promptly from "promptly-sdk";

const client = new Promptly({ apiKey: "sk-promptly-..." });

const response = await client.chat.completions.create({
  model: "gpt-4o",
  messages: [{ role: "user", content: "Hello!" }],
});

console.log(response.choices[0].message.content);

Streaming

const stream = await client.chat.completions.create({
  model: "gpt-4o",
  messages: [{ role: "user", content: "Write a poem." }],
  stream: true,
});

for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content || "");
}

Access Promptly Metadata

const response = await client.chat.completions.create({
  model: "gpt-4o",
  messages: [{ role: "user", content: "Hello!" }],
});

const meta = response.promptly_metadata;
console.log(`Saved: $${meta.savings}`);
console.log(`Routed to: ${meta.routed_model}`);
console.log(`Cache hit: ${meta.cache_hit}`);

Wrap Existing Client

import OpenAI from "openai";
import { wrap } from "promptly-sdk";

const client = wrap(new OpenAI({ apiKey: "sk-openai-..." }));

Requirements

• Node.js 18+
• openai >= 4.0.0