@memberjunction/ai-cerebras

MemberJunction AI provider for Cerebras' ultra-fast inference platform. This package extends the OpenAI provider to work with Cerebras' OpenAI-compatible API, providing access to high-performance LLM inference with extremely low latency powered by Cerebras' wafer-scale engine.

Architecture

graph TD
    A["CerebrasLLM<br/>(Provider)"] -->|extends| B["OpenAILLM<br/>(@memberjunction/ai-openai)"]
    B -->|extends| C["BaseLLM<br/>(@memberjunction/ai)"]
    A -->|overrides base URL| D["Cerebras API<br/>(api.cerebras.ai/v1)"]
    C -->|registered via| E["@RegisterClass"]
    A -->|inherits| F["Streaming Support"]
    A -->|inherits| G["Chat Completions"]
    A -->|inherits| H["Thinking Extraction"]

    style A fill:#7c5295,stroke:#563a6b,color:#fff
    style B fill:#2d6a9f,stroke:#1a4971,color:#fff
    style C fill:#2d6a9f,stroke:#1a4971,color:#fff
    style D fill:#2d8659,stroke:#1a5c3a,color:#fff
    style E fill:#b8762f,stroke:#8a5722,color:#fff
    style F fill:#2d8659,stroke:#1a5c3a,color:#fff
    style G fill:#2d8659,stroke:#1a5c3a,color:#fff
    style H fill:#2d8659,stroke:#1a5c3a,color:#fff

Features

• Ultra-Fast Inference: Leverages Cerebras' wafer-scale engine for extremely low latency
• OpenAI Compatible: Inherits all features from the OpenAI provider (chat, streaming, response formats)
• Streaming: Full streaming support inherited from OpenAI provider
• Thinking/Reasoning: Thinking block extraction support for reasoning models
• Token Usage Tracking: Track token consumption for monitoring

Installation

npm install @memberjunction/ai-cerebras

Usage

import { CerebrasLLM } from '@memberjunction/ai-cerebras';

const llm = new CerebrasLLM('your-cerebras-api-key');

const result = await llm.ChatCompletion({
    model: 'llama3.1-70b',
    messages: [
        { role: 'system', content: 'You are a helpful assistant.' },
        { role: 'user', content: 'Explain the benefits of specialized AI hardware.' }
    ],
    temperature: 0.7,
    maxOutputTokens: 1000
});

if (result.success) {
    console.log(result.data.choices[0].message.content);
}

Streaming

const result = await llm.ChatCompletion({
    model: 'llama3.1-8b',
    messages: [{ role: 'user', content: 'Write a poem about AI.' }],
    streaming: true,
    streamingCallbacks: {
        OnContent: (content) => process.stdout.write(content),
        OnComplete: () => console.log('\nDone!')
    }
});

How It Works

CerebrasLLM is a thin subclass of OpenAILLM that redirects API calls to Cerebras' endpoint at https://api.cerebras.ai/v1. All chat, streaming, and parameter handling logic is inherited from the OpenAI provider.

Supported Parameters

All parameters supported by the OpenAI provider are available, including temperature, maxOutputTokens, topP, frequencyPenalty, presencePenalty, seed, stopSequences, and responseFormat.

Class Registration

Registered as CerebrasLLM via @RegisterClass(BaseLLM, 'CerebrasLLM').

Dependencies

• @memberjunction/ai - Core AI abstractions
• @memberjunction/ai-openai - OpenAI provider (parent class)
• @memberjunction/global - Class registration