AI TOOLKIT - DeepInfra Provider

The DeepInfra provider for the AI TOOLKIT contains language model support for the DeepInfra API, giving you access to models like Llama 3, Mixtral, and other state-of-the-art LLMs.

Setup

The DeepInfra provider is available in the @ai-toolkit/deepinfra module. You can install it with

npm i @ai-toolkit/deepinfra

Provider Instance

You can import the default provider instance deepinfra from @ai-toolkit/deepinfra:

import { deepinfra } from '@ai-toolkit/deepinfra';

Example

import { deepinfra } from '@ai-toolkit/deepinfra';
import { generateText } from 'ai-toolkit';

const { text } = await generateText({
  model: deepinfra('meta-llama/Llama-3.3-70B-Instruct'),
  prompt: 'Write a vegetarian lasagna recipe for 4 people.',
});

Documentation

Please check out the DeepInfra provider documentation for more information.