Groq Plugin

Fast LLM inference API plugin for OpenPets. Provides access to Groq's ultra-low latency LPU inference engine with OpenAI-compatible endpoints.

Features

• Chat Completions - Create chat completions using Llama, Gemma, Mixtral and other models
• Responses API - New simplified API for text generation (beta)
• Audio Transcription - Transcribe audio to text using Whisper models
• Audio Translation - Translate audio to English
• Text-to-Speech - Generate speech from text
• Model Management - List and retrieve model information
• Batch Processing - Create and manage batch jobs
• File Management - Upload and manage files for batch processing

Setup

1. Get your API key from Groq Console
2. Set the GROQ_API_KEY environment variable:

export GROQ_API_KEY="your-api-key"

Or add it to your .env file:

GROQ_API_KEY=your-api-key

Usage

Test Connection

opencode run "test Groq connection"

List Available Models

opencode run "list available Groq models"

Create Chat Completion

opencode run "create a chat completion using llama-3.3-70b-versatile model"

Transcribe Audio

opencode run "transcribe this audio file" --env "AUDIO_URL=https://example.com/audio.mp3"

Available Models

Popular models on Groq:

• llama-3.3-70b-versatile - Fast general-purpose model
• llama-3.1-8b-instant - Fast & cheap inference
• mixtral-8x7b-32768 - Large context model
• gemma2-9b-it - Google's instruction-tuned model
• whisper-large-v3 - Audio transcription
• playai-tts - Text-to-speech

Tool Reference

| Tool | Description | |------|-------------| | groq-test-connection | Test API connection and list available models | | groq-list-models | List all available models | | groq-get-model | Get details about a specific model | | groq-create-chat-completion | Create a chat completion | | groq-create-response | Create a response (beta) | | groq-transcribe-audio | Transcribe audio to text | | groq-translate-audio | Translate audio to English | | groq-create-speech | Generate speech from text | | groq-list-batches | List batch jobs | | groq-get-batch | Get batch details | | groq-cancel-batch | Cancel a batch job | | groq-upload-file | Upload file for batch processing | | groq-list-files | List uploaded files | | groq-get-file | Get file details | | groq-delete-file | Delete a file |

License

MIT