AI SDK - DeepInfra Provider

The DeepInfra provider for the AI SDK contains language model support for the DeepInfra API, giving you access to models like Llama 3, Mixtral, and other state-of-the-art LLMs.

Setup

The DeepInfra provider is available in the @ai-sdk/deepinfra module. You can install it with

npm i @ai-sdk/deepinfra

Provider Instance

You can import the default provider instance deepinfra from @ai-sdk/deepinfra:

import { deepinfra } from '@markeljan/ai-sdk-deepinfra';

Example

import { deepinfra } from '@markeljan/ai-sdk-deepinfra';
import { generateText } from '@markeljan/ai';

const { text } = await generateText({
  model: deepinfra('meta-llama/Llama-3.3-70B-Instruct'),
  prompt: 'Write a vegetarian lasagna recipe for 4 people.',
});

Documentation

Please check out the DeepInfra provider documentation for more information.