@mastra/voice-sarvam

Sarvam Voice integration for Mastra, providing Text-to-Speech (TTS) and Speech-to-text (STT) capabilities using Sarvam's voice technology.

Installation

npm install @mastra/voice-sarvam

Configuration

The module requires the following environment variables:

SARVAM_API_KEY=your_api_key

Usage

import { SarvamVoice } from '@mastra/voice-sarvam';

const voice = new SarvamVoice({
  speechModel: {
    model: 'bulbul:v1',
    apiKey: process.env.SARVAM_API_KEY!,
    language: 'en-IN',
  },
  listeningModel: {
    apiKey: process.env.SARVAM_API_KEY!,
    model: 'saarika:v2',
    languageCode: 'unknown', // By default only works with saarika:v2
  },
  speaker: 'meera',
});

// Create an agent with voice capabilities
export const agent = new Agent({
  name: 'Agent',
  instructions: `You are a helpful assistant with both TTS and STT capabilities.`,
  model: google('gemini-1.5-pro-latest'),
  voice: voice,
});

// List available speakers
const speakers = await voice.getSpeakers();

// Generate speech and save to file
const audio = await agent.voice.speak("Hello, I'm your AI assistant!");
const filePath = path.join(process.cwd(), 'agent.wav');
const writer = createWriteStream(filePath);

audio.pipe(writer);

await new Promise<void>((resolve, reject) => {
  writer.on('finish', () => resolve());
  writer.on('error', reject);
});

// Generate speech from a text stream
const textStream = getTextStream(); // Your text stream source
const audioStream = await voice.speak(textStream);

// The stream can be piped to a destination
const streamFilePath = path.join(process.cwd(), 'stream.mp3');
const streamWriter = createWriteStream(streamFilePath);

audioStream.pipe(streamWriter);

console.log(`Speech saved to ${filePath} and ${streamFilePath}`);

// Generate Text from an audio stream
const text = await voice.listen(audioStream);

Features

• High-quality Text-to-Speech and Speech-to-Text synthesis
• Support for 10+ Indian languages
• Choice of 10+ diverse speakers
• Advanced voice customization options

Available Voices

Speakers

• meera (default)
• pavithra
• maitreyi
• arvind
• amol
• amartya
• diya
• neel
• misha
• vian
• arjun
• maya

Languages

| Language | Code | | --------- | ----- | | English | en-IN | | Hindi | hi-IN | | Bengali | bn-IN | | Kannada | kn-IN | | Malayalam | ml-IN | | Marathi | mr-IN | | Odia | od-IN | | Punjabi | pa-IN | | Tamil | ta-IN | | Telugu | te-IN | | Gujarati | gu-IN |