openai — Multimodal Reasoning Bridge

Vision, imagination, and perception. The intelligence of OpenAI, delivered through the Model Context Protocol.

Part of FRE4X-B1TE — a monorepo of MCP servers built for autonomous agents.

This B1TE bridges your agent directly to OpenAI's advanced models — enabling it to see with GPT-4o, imagine with DALL-E 3, and hear with Whisper.

Tools

| Tool | Capability | |------|-----------| | openai_analyze_media | Analyze an image from a file:// or http(s):// URL. Prompt is optional. | | openai_list_models | List available OpenAI models with pagination. | | openai_generate_image | Image synthesis via DALL-E 3. Optionally save to output_dir. | | openai_transcribe_audio | Transcribe local audio files using Whisper (whisper-1). | | openai_generate_speech | Generate speech audio from text and optionally save it locally. |

Setup

Environment Variables

• OPENAI_API_KEY: Your OpenAI API key.
• MOCK: Set to true to use mock data instead of real API calls.

Claude Desktop Configuration

{
  "mcpServers": {
    "openai": {
      "command": "npx",
      "args": ["-y", "@fre4x/openai"],
      "env": {
        "OPENAI_API_KEY": "your-key-here"
      }
    }
  }
}

Features

• Protocol Compliance: Implements the split content (Markdown) and structuredContent (Raw Data) model for high-fidelity agent interaction.
• Agent-Sufficient Output: content.text carries enough detail for autonomous follow-up, including model IDs, generated image URLs, revised prompts, saved paths, transcript metadata, and speech metadata.
• Strict Validation: All tools utilize outputSchema for reliable data parsing and reduced hallucinations.
• Privacy & Security: Aggressively masks implementation details (HTTP codes, library names) in error messages.
• Token Efficiency: Mandatory pagination for model listing.
• Vision Input Contract: openai_analyze_media accepts only file:// and http(s):// URLs. data: URLs are rejected at validation time.

Development

npm install
npm run build
npm run typecheck
npm test
MOCK=true npm run inspector

License

MIT — WE ARE THE FRE4X.