AI SDK - ByteDance Provider

The ByteDance provider for the AI SDK contains video model support for ByteDance's Seedance family of video generation models through the BytePlus ModelArk platform.

Deploying to Vercel? With Vercel's AI Gateway you can access ByteDance (and hundreds of models from other providers) — no additional packages, API keys, or extra cost. Get started with AI Gateway.

Setup

The ByteDance provider is available in the @ai-sdk/bytedance module. You can install it with:

npm i @ai-sdk/bytedance

Skill for Coding Agents

If you use coding agents such as Claude Code or Cursor, we highly recommend adding the AI SDK skill to your repository:

npx skills add vercel/ai

Provider Instance

You can import the default provider instance byteDance from @ai-sdk/bytedance:

import { byteDance } from '@ai-sdk/bytedance';

Video Models

This provider supports text-to-video, image-to-video, audio-video sync, first-and-last frame control, and multi-reference image generation.

Text-to-Video

Generate video from a text prompt.

Available models: seedance-1-5-pro-251215, seedance-1-0-pro-250528, seedance-1-0-pro-fast-251015, seedance-1-0-lite-t2v-250428

import { byteDance, type ByteDanceVideoModelOptions } from '@ai-sdk/bytedance';
import { experimental_generateVideo as generateVideo } from 'ai';

const { video } = await generateVideo({
  model: byteDance.video('seedance-1-0-pro-250528'),
  prompt: 'A cat playing with a ball of yarn in a sunlit room',
  aspectRatio: '16:9',
  duration: 5,
  providerOptions: {
    bytedance: {
      watermark: false,
    } satisfies ByteDanceVideoModelOptions,
  },
});

console.log(video.url);

Image-to-Video

Generate video from a first-frame image with an optional text prompt.

Available models: seedance-1-5-pro-251215, seedance-1-0-pro-250528, seedance-1-0-pro-fast-251015, seedance-1-0-lite-i2v-250428

import { byteDance, type ByteDanceVideoModelOptions } from '@ai-sdk/bytedance';
import { experimental_generateVideo as generateVideo } from 'ai';

const { video } = await generateVideo({
  model: byteDance.video('seedance-1-5-pro-251215'),
  prompt: {
    image: 'https://example.com/first-frame.png',
    text: 'The cat slowly turns its head and blinks',
  },
  duration: 5,
  providerOptions: {
    bytedance: {
      watermark: false,
    } satisfies ByteDanceVideoModelOptions,
  },
});

Image-to-Video with Audio

Seedance 1.5 Pro supports generating synchronized audio alongside the video.

import { byteDance, type ByteDanceVideoModelOptions } from '@ai-sdk/bytedance';
import { experimental_generateVideo as generateVideo } from 'ai';

const { video } = await generateVideo({
  model: byteDance.video('seedance-1-5-pro-251215'),
  prompt: {
    image: 'https://example.com/pianist.png',
    text: 'A young man sits at a piano, playing calmly. Gentle piano music plays in sync.',
  },
  duration: 5,
  providerOptions: {
    bytedance: {
      generateAudio: true,
      watermark: false,
    } satisfies ByteDanceVideoModelOptions,
  },
});

First-and-Last Frame Video

Generate smooth transitions between a starting and ending keyframe image.

import { byteDance, type ByteDanceVideoModelOptions } from '@ai-sdk/bytedance';
import { experimental_generateVideo as generateVideo } from 'ai';

const { video } = await generateVideo({
  model: byteDance.video('seedance-1-5-pro-251215'),
  prompt: {
    image: 'https://example.com/first-frame.jpg',
    text: 'Create a 360-degree orbiting camera shot based on this photo',
  },
  duration: 5,
  providerOptions: {
    bytedance: {
      lastFrameImage: 'https://example.com/last-frame.jpg',
      generateAudio: true,
      watermark: false,
    } satisfies ByteDanceVideoModelOptions,
  },
});

Multi-Reference Image-to-Video

Provide multiple reference images (1-4) that the model uses to faithfully reproduce object shapes, colors, and textures. Use [Image 1], [Image 2], etc. in your prompt to reference specific images.

Available models: seedance-1-0-lite-i2v-250428

import { byteDance, type ByteDanceVideoModelOptions } from '@ai-sdk/bytedance';
import { experimental_generateVideo as generateVideo } from 'ai';

const { video } = await generateVideo({
  model: byteDance.video('seedance-1-0-lite-i2v-250428'),
  prompt:
    'A boy from [Image 1] and a corgi from [Image 2], sitting on the lawn from [Image 3]',
  aspectRatio: '16:9',
  duration: 5,
  providerOptions: {
    bytedance: {
      referenceImages: [
        'https://example.com/boy.png',
        'https://example.com/corgi.png',
        'https://example.com/lawn.png',
      ],
      watermark: false,
    } satisfies ByteDanceVideoModelOptions,
  },
});

Provider Options

Use providerOptions.bytedance to configure video generation. You can type the object with ByteDanceVideoModelOptions.

| Option | Description | | ----------------- | ------------------------------------------------------------------------------ | | watermark | Whether to add a watermark to the generated video | | generateAudio | Generate synchronized audio for supported Seedance models | | cameraFixed | Whether to fix the camera during generation | | returnLastFrame | Return the last frame of the generated video (useful for chaining) | | serviceTier | 'default' for online inference, 'flex' for offline at 50% price | | draft | Enable draft mode for low-cost 480p preview generation (Seedance 1.5 Pro only) | | lastFrameImage | URL of last frame image for first-and-last frame generation | | referenceImages | Array of reference image URLs for multi-reference generation | | referenceVideos | Array of reference video URLs for reference-guided generation | | referenceAudio | Array of reference audio URLs for audio-guided generation | | pollIntervalMs | Poll interval for async generation (default: 3000ms) | | pollTimeoutMs | Max wait time for generation (default: 300000ms) |

Supported aspect ratios: 16:9, 4:3, 1:1, 3:4, 9:16, 21:9, adaptive (image-to-video only).

Authentication

Set the ARK_API_KEY environment variable:

ARK_API_KEY=your-api-key

Or pass it directly:

import { createByteDance } from '@ai-sdk/bytedance';

const byteDance = createByteDance({
  apiKey: 'your-api-key',
});

You can obtain an API key from the BytePlus console.

Documentation

Please check out the ByteDance provider for more information.