pi-ollama-api

Ollama Cloud provider extension for Pi — connect your terminal coding agent to 200+ models on Ollama Cloud via the OpenAI-compatible API.

Features

• Native Ollama API discovery — Queries /api/tags and /api/show for real model metadata (context windows, capabilities, parameter sizes, quantization)
• Actual context windows — No hardcoded defaults. Every model reports its real context length from Ollama's API (e.g., 1M for DeepSeek V4, 262K for Kimi K2, 128K for GPT-OSS)
• Capability detection — Vision, reasoning, tools detected from Ollama's capabilities array
• OpenAI-compatible API — Uses openai-completions streaming (works with all Pi features)
• Embeddings tool — Generate embeddings via /v1/embeddings for RAG and similarity search
• Direct chat tool — Send one-off completions for model comparison or testing

Supported Model Families

| Family | Models | Highlights | |--------|--------|------------| | Llama | 3.3, 3.2, 3.1, 3, 2 | 70B frontier, Vision variants, 405B | | Qwen | 3, 2.5, 2, VL, Coder, Math | 128K context, Vision, Code, Math variants | | DeepSeek | R1, V3, V2, Coder V2 | Reasoning (R1), 671B total | | Mistral | Codestral, Mistral, Nemo, Large, Mixtral | 256K context Codestral | | Gemma | 3, 2, CodeGemma, ShieldGemma | Vision support, 128K context | | Phi | 4, 3.5, 3 | Microsoft models, 128K context | | IBM | Granite 3.x, Granite Code | MoE variants, 128K context | | Cohere | Command R, Aya, Aya Expanse | Multilingual, 128K context | | GPT-OSS | 120B, 20B (Cloud) | Cloud-hosted OSS models | | + 30+ more | Yi, Falcon, GLM, InternLM, SOLAR, etc. | See full list in source |

Installation

# Install via pi
pi install npm:pi-ollama-api

# Or install locally
pi install npm:pi-ollama-api -l

Setup

1. Get an API key from ollama.com/settings
2. Start Pi and run:

   /ollama-cloud-login

   Paste your API key when prompted. It is stored in Pi's ~/.pi/agent/auth.json (same place as /login credentials).
3. Select a model with /model → pick any ollama-cloud/* model

Authentication

| Method | How | Where stored | |--------|-----|-------------| | Pi /login (recommended) | Run /login in Pi → select "Use an API key" | ~/.pi/agent/auth.json | | Environment variable | export OLLAMA_API_KEY=... | Shell env |

Pi's AuthStorage is used natively — API keys are checked in auth.json first, then the env var is used as a fallback.

Environment Variables

| Variable | Default | Description | |----------|---------|-------------| | OLLAMA_API_KEY | — | Fallback API key (used if auth.json has no key) | | OLLAMA_CLOUD_BASE_URL | https://ollama.com/v1 | Override endpoint (for proxies or self-hosted) | | OLLAMA_CLOUD_MODELS | — | Comma-separated list to skip discovery and use static models | | OLLAMA_CLOUD_TIMEOUT | 30000 | Model discovery timeout in ms |

Usage

Select a model

/model

Then pick any ollama-cloud/* model. Examples:

• ollama-cloud/llama3.3 — Llama 3.3 70B
• ollama-cloud/qwen3 — Qwen 3 with vision
• ollama-cloud/deepseek-r1 — DeepSeek R1 with reasoning
• ollama-cloud/gemma3:27b — Gemma 3 27B with vision

Commands

| Command | Description | |---------|-------------| | /ollama-cloud-status | Check API key status and model count | | /ollama-cloud-refresh | Re-fetch live model list from Ollama Cloud API | | /ollama-cloud-list | Pretty-print all models with 🧠/🖼️/💬 badges | | /ollama-cloud-pull <id> | Show the ollama pull command for a model |

Tools (LLM-callable)

| Tool | Purpose | |------|---------| | ollama_list_models | Filter models by family, vision, or reasoning | | ollama_embeddings | Generate embeddings via /v1/embeddings | | ollama_chat | Direct chat completion via /v1/chat/completions | | ollama_model_info | Get detailed metadata for a specific model |

Quick Examples

# Check what models are available
Use ollama_list_models to show all available models

# Get embeddings for a document
Use ollama_embeddings with model "nomic-embed-text" and input "The quick brown fox"

# Compare model outputs
Use ollama_chat with model "llama3.3" and messages [{role: "user", content: "Hello"}]
Use ollama_chat with model "qwen3" and messages [{role: "user", content: "Hello"}]

API Compatibility

This extension uses Ollama's OpenAI-compatible API (/v1/chat/completions), which supports:

• Chat completions with streaming
• Vision (multimodal) inputs
• Tool calling
• JSON mode
• Reasoning/thinking control
• Embeddings (/v1/embeddings)

License

MIT