@memberjunction/ai-azure

MemberJunction AI provider for Azure OpenAI Service. This package provides both LLM and embedding capabilities through Azure's enterprise-grade deployment of OpenAI models, implementing BaseLLM and BaseEmbeddings from @memberjunction/ai.

Architecture

graph TD
    A["AzureLLM<br/>(Provider)"] -->|extends| B["BaseLLM<br/>(@memberjunction/ai)"]
    C["AzureEmbedding<br/>(Provider)"] -->|extends| D["BaseEmbeddings<br/>(@memberjunction/ai)"]
    A -->|wraps| E["Azure AI Inference<br/>REST Client"]
    C -->|wraps| E
    A -->|authenticates via| F["API Key or<br/>Azure AD (Entra ID)"]
    B -->|registered via| G["@RegisterClass"]
    D -->|registered via| G

    style A fill:#7c5295,stroke:#563a6b,color:#fff
    style C fill:#7c5295,stroke:#563a6b,color:#fff
    style B fill:#2d6a9f,stroke:#1a4971,color:#fff
    style D fill:#2d6a9f,stroke:#1a4971,color:#fff
    style E fill:#2d8659,stroke:#1a5c3a,color:#fff
    style F fill:#b8762f,stroke:#8a5722,color:#fff
    style G fill:#b8762f,stroke:#8a5722,color:#fff

Features

• Chat Completions: Full support for Azure-hosted language models including GPT-4, GPT-3.5-Turbo, and Phi-4
• Streaming Support: Real-time streaming responses for enhanced user experience
• Text Embeddings: Generate vector embeddings for semantic search and similarity matching
• Dual Authentication: Support for both API key and Azure Active Directory (Entra ID) authentication
• Text Processing: Built-in text summarization and classification capabilities
• Type Safety: Full TypeScript support with comprehensive type definitions
• Factory Pattern: Seamless integration with MemberJunction's AI factory system

Installation

npm install @memberjunction/ai-azure

Configuration

Prerequisites

1. An Azure subscription with Azure AI or Azure OpenAI service deployed
2. Either an API key for your Azure AI resource or Azure AD credentials
3. The endpoint URL for your Azure AI resource

Authentication Methods

API Key Authentication

import { AzureLLM } from '@memberjunction/ai-azure';

const azureLLM = new AzureLLM('your-api-key');

azureLLM.SetAdditionalSettings({
    endpoint: 'https://your-resource.openai.azure.com/'
});

Azure AD Authentication

const azureLLM = new AzureLLM('');

azureLLM.SetAdditionalSettings({
    endpoint: 'https://your-resource.openai.azure.com/',
    useAzureAD: true
});

Usage

Chat Completion

const result = await azureLLM.ChatCompletion({
    model: 'gpt-4',
    messages: [
        { role: 'system', content: 'You are a helpful assistant.' },
        { role: 'user', content: 'Explain the theory of relativity.' }
    ],
    maxOutputTokens: 500,
    temperature: 0.7
});

if (result.success) {
    console.log(result.data.choices[0].message.content);
}

Streaming

const result = await azureLLM.ChatCompletion({
    model: 'gpt-4',
    messages: [{ role: 'user', content: 'Write a detailed story.' }],
    streaming: true,
    streamingCallbacks: {
        OnContent: (content) => process.stdout.write(content),
        OnComplete: (result) => console.log('\nDone!')
    }
});

Embeddings

import { AzureEmbedding } from '@memberjunction/ai-azure';

const embedder = new AzureEmbedding('your-api-key');
embedder.SetAdditionalSettings({
    endpoint: 'https://your-resource.openai.azure.com/'
});

const result = await embedder.EmbedText({
    model: 'text-embedding-ada-002',
    text: 'Sample text for embedding'
});

console.log(`Dimensions: ${result.vector.length}`);

Configuration Options

| Setting | Type | Required | Description | |---------|------|----------|-------------| | endpoint | string | Yes | Azure AI resource endpoint URL | | useAzureAD | boolean | No | Use Azure AD authentication instead of API key |

Supported Parameters

| Parameter | Supported | Notes | |-----------|-----------|-------| | temperature | Yes | 0.0 - 2.0 | | maxOutputTokens | Yes | Maximum tokens to generate | | topP | Yes | Nucleus sampling (0.0 - 1.0) | | frequencyPenalty | Yes | -2.0 to 2.0 | | presencePenalty | Yes | -2.0 to 2.0 | | seed | Yes | Deterministic outputs | | stopSequences | Yes | Stop generation sequences | | responseFormat | Yes | Text, JSON, Markdown | | streaming | Yes | Real-time streaming | | topK | No | Not available in Azure OpenAI | | minP | No | Not available in Azure OpenAI |

Class Registration

• AzureLLM -- Registered via @RegisterClass(BaseLLM, 'AzureLLM')
• AzureEmbedding -- Registered via @RegisterClass(BaseEmbeddings, 'AzureEmbedding')

Dependencies

• @memberjunction/ai - Core AI abstractions
• @memberjunction/global - Class registration
• @azure-rest/ai-inference - Azure AI inference REST client
• @azure/core-auth - Azure authentication core
• @azure/identity - Azure identity and credential management