prometey-ai-sdk
v0.1.0
Published
Prometey provider for the Vercel AI SDK: run generateText, streamText and friends on your users' own AI (free tiers and their keys) through Prometey's auto router.
Maintainers
Readme
prometey-ai-sdk
Prometey for the Vercel AI SDK. Your app's generateText (structured output included), streamText and embed calls run on your users' own AI (their free tiers and API keys), picked per request by Prometey's auto router.
npm install prometey-ai-sdk aiimport { createPrometey } from 'prometey-ai-sdk';
import { generateText, streamText } from 'ai';
const prometey = createPrometey({ baseURL: 'https://YOUR-PROMETEY-HOST', apiKey: userToken });
const { text } = await generateText({ model: prometey('auto'), prompt: 'Write a haiku about Mondays' });
const result = streamText({ model: prometey('auto:fast'), prompt: 'Tell me a joke' });
for await (const piece of result.textStream) process.stdout.write(piece);The user's token
apiKey accepts:
- a string: a user's token from "Connect Prometey", or an API key from your Prometey dashboard for your own scripts;
- a function (sync or async), called before each request: handy when tokens live in a session store;
- a connected
Prometeyclient from prometey-sdk in the browser:
import { Prometey } from 'prometey-sdk';
const client = new Prometey({ baseUrl: 'https://YOUR-PROMETEY-HOST' });
await client.ready(); // after the user connected
const prometey = createPrometey({ baseURL: client.baseUrl, apiKey: client });Without a token, calls fail with PrometeyNotConnectedError before reaching the network.
Models
| Model | Picks |
|---|---|
| auto | The best model for each request among the user's providers |
| auto:fast / auto:best | Leaning towards speed / quality |
| auto:cascade | A fast model first, a stronger one if the answer looks weak |
| auto:<task> (e.g. auto:code:generation) | The best model for that task |
| provider/model | That exact model |
prometey.embeddingModel('nemotron-3-embed-1b') and prometey.imageModel('auto') work too.
What your features need
const prometey = createPrometey({ baseURL, apiKey, requires: { vision: true, json: true, quality: 'best' } });Prometey then only routes to models that can do it (vision, tools, json, min_context, quality).
Who answered
const r = await generateText({ model: prometey('auto'), prompt: 'Hi' });
r.providerMetadata?.prometey; // { provider: 'groq', model: 'openai/gpt-oss-120b', requestId: '…' }MIT licensed.
