@ai_inference_network/client-sdk

Simple TypeScript client SDK for direct consumption from external apps.

Install

pnpm add @ai_inference_network/client-sdk

Config

Pass values via constructor options.

• NETWORK_API_KEY (required)
• GATEWAY_HTTP_URL (required)
• INFERENCE_PATH (required)

Usage

import { ClientSDK } from '@ai_inference_network/client-sdk';

const sdk = new ClientSDK({
  apiKey: 'sk_client_xxx',
  baseUrl: 'http://localhost:3000',
  inferencePath: '/v1/inference',
});

const res = await sdk.inference({
  model: 'llama3.2:3b',
  messages: [
    { role: 'system', content: 'You are helpful.' },
    { role: 'user', content: 'Write a short intro.' }
  ],
  temperature: 0.7,
  top_p: 0.95,
  max_tokens: 256,
  stop: ['</END>'],
  user: 'user_123'
});

console.log(res.output, res.usage);