@sdjz/ai-sdk-provider-nvidia-nim

NVIDIA NIM provider for @sdjz/ai-sdk.

Default base URL: https://integrate.api.nvidia.com/v1

Installation

npm install @sdjz/ai-sdk @sdjz/ai-sdk-provider-openai @sdjz/ai-sdk-provider-nvidia-nim

Usage

import { createAI } from '@sdjz/ai-sdk'
import { nvidiaNim } from '@sdjz/ai-sdk-provider-nvidia-nim'

const provider = nvidiaNim({
  apiKey: process.env.NVIDIA_API_KEY,
  model: 'meta/llama-3.1-8b-instruct',
})

const ai = createAI({ provider })
const result = await ai.chat('Hello')

console.log(result.text)

API Key Resolution

1. options.apiKey
2. NVIDIA_API_KEY
3. NGC_API_KEY

List Models

const models = await provider.models()
console.log(models.map((m) => m.id))

License

MIT