Lynkr - Run Cursor, Cline, Continue, OpenAi Compatible Tools and Claude Code on any model.

One universal LLM proxy for AI coding tools.

Use Case

        Cursor / Cline / Continue / Claude Code / Clawdbot / Codex/ KiloCode
                        ↓
                       Lynkr
                        ↓
        Local LLMs | OpenRouter | Azure | Databricks | AWS BedRock | Ollama | LMStudio | Gemini

Overview

Lynkr is a self-hosted proxy server that unlocks Claude Code CLI , Cursor IDE and Codex Cli by enabling:

• 🚀 Any LLM Provider - Databricks, AWS Bedrock (100+ models), OpenRouter (100+ models), Ollama (local), llama.cpp, Azure OpenAI, Azure Anthropic, OpenAI, LM Studio
• 💰 60-80% Cost Reduction - Built-in token optimization with smart tool selection, prompt caching, and memory deduplication
• 🔒 100% Local/Private - Run completely offline with Ollama or llama.cpp
• 🌐 Remote or Local - Connect to providers on any IP/hostname (not limited to localhost)
• 🎯 Zero Code Changes - Drop-in replacement for Anthropic's backend
• 🏢 Enterprise-Ready - Circuit breakers, load shedding, Prometheus metrics, health checks

Perfect for:

• Developers who want provider flexibility and cost control
• Enterprises needing self-hosted AI with observability
• Privacy-focused teams requiring local model execution
• Teams seeking 60-80% cost reduction through optimization

Quick Start

Installation

Option 1: NPM Package (Recommended)

# Install globally
npm install -g pino-pretty 
npm install -g lynkr

lynk start

Option 2: Git Clone

# Clone repository
git clone https://github.com/vishalveerareddy123/Lynkr.git
cd Lynkr

# Install dependencies
npm install

# Create .env from example
cp .env.example .env

# Edit .env with your provider credentials
nano .env

# Start server
npm start

Node.js Compatibility:

• Node 20-24: Full support with all features
• Node 25+: Full support (native modules auto-rebuild, babel fallback for code parsing)

Option 3: Docker

docker-compose up -d

Supported Providers

Lynkr supports 10+ LLM providers:

| Provider | Type | Models | Cost | Privacy | |----------|------|--------|------|---------| | AWS Bedrock | Cloud | 100+ (Claude, Titan, Llama, Mistral, etc.) | $$-$$$ | Cloud | | Databricks | Cloud | Claude Sonnet 4.5, Opus 4.5 | $$$ | Cloud | | OpenRouter | Cloud | 100+ (GPT, Claude, Llama, Gemini, etc.) | $-$$ | Cloud | | Ollama | Local | Unlimited (free, offline) | FREE | 🔒 100% Local | | llama.cpp | Local | GGUF models | FREE | 🔒 100% Local | | Azure OpenAI | Cloud | GPT-4o, GPT-5, o1, o3 | $$$ | Cloud | | Azure Anthropic | Cloud | Claude models | $$$ | Cloud | | OpenAI | Cloud | GPT-4o, o1, o3 | $$$ | Cloud | | LM Studio | Local | Local models with GUI | FREE | 🔒 100% Local | | MLX OpenAI Server | Local | Apple Silicon (M1/M2/M3/M4) | FREE | 🔒 100% Local |

📖 Full Provider Configuration Guide

Claude Code Integration

Configure Claude Code CLI to use Lynkr:

# Set Lynkr as backend
export ANTHROPIC_BASE_URL=http://localhost:8081
export ANTHROPIC_API_KEY=dummy

# Run Claude Code
claude "Your prompt here"

That's it! Claude Code now uses your configured provider.

📖 Detailed Claude Code Setup

Cursor Integration

Configure Cursor IDE to use Lynkr:

1. Open Cursor Settings

   • Mac: Cmd+, | Windows/Linux: Ctrl+,
   • Navigate to: Features → Models

2. Configure OpenAI API Settings

   • API Key: sk-lynkr (any non-empty value)
   • Base URL: http://localhost:8081/v1
   • Model: claude-3.5-sonnet (or your provider's model)

3. Test It

   • Chat: Cmd+L / Ctrl+L
   • Inline edits: Cmd+K / Ctrl+K
   • @Codebase search: Requires embeddings setup

📖 Full Cursor Setup Guide | Embeddings Configuration

Codex CLI Integration

Configure OpenAI Codex CLI to use Lynkr as its backend.

Option 1: Environment Variables (Quick Start)

export OPENAI_BASE_URL=http://localhost:8081/v1
export OPENAI_API_KEY=dummy

codex

Option 2: Config File (Recommended)

Edit ~/.codex/config.toml:

# Set Lynkr as the default provider
model_provider = "lynkr"
model = "gpt-4o"

# Define the Lynkr provider
[model_providers.lynkr]
name = "Lynkr Proxy"
base_url = "http://localhost:8081/v1"
wire_api = "responses"

# Optional: Trust your project directories
[projects."/path/to/your/project"]
trust_level = "trusted"

Configuration Options

| Option | Description | Example | |--------|-------------|---------| | model_provider | Active provider name | "lynkr" | | model | Model to request (mapped by Lynkr) | "gpt-4o", "claude-sonnet-4-5" | | base_url | Lynkr endpoint | "http://localhost:8081/v1" | | wire_api | API format (responses or chat) | "responses" | | trust_level | Project trust (trusted, sandboxed) | "trusted" |

Remote Lynkr Server

To connect Codex to a remote Lynkr instance:

[model_providers.lynkr-remote]
name = "Remote Lynkr"
base_url = "http://192.168.1.100:8081/v1"
wire_api = "responses"

Troubleshooting

| Issue | Solution | |-------|----------| | Same response for all queries | Disable semantic cache: SEMANTIC_CACHE_ENABLED=false | | Tool calls not executing | Increase threshold: POLICY_TOOL_LOOP_THRESHOLD=15 | | Slow first request | Keep Ollama loaded: OLLAMA_KEEP_ALIVE=24h | | Connection refused | Ensure Lynkr is running: npm start |

Note: Codex uses the OpenAI Responses API format. Lynkr automatically converts this to your configured provider's format.

ClawdBot Integration

Lynkr supports ClawdBot via its OpenAI-compatible API. ClawdBot users can route requests through Lynkr to access any supported provider.

Configuration in ClawdBot: | Setting | Value | |---------|-------| | Model/auth provider | Copilot | | Copilot auth method | Copilot Proxy (local) | | Copilot Proxy base URL | http://localhost:8081/v1 | | Model IDs | Any model your Lynkr provider supports |

Available models (depending on your Lynkr provider): gpt-5.2, gpt-5.1-codex, claude-opus-4.5, claude-sonnet-4.5, claude-haiku-4.5, gemini-3-pro, gemini-3-flash, and more.

🌐 Remote Support: ClawdBot can connect to Lynkr on any machine - use any IP/hostname in the Proxy base URL (e.g., http://192.168.1.100:8081/v1 or http://gpu-server:8081/v1).

Lynkr also supports Cline, Continue.dev and other OpenAI compatible tools.

Documentation

Getting Started

• 📦 Installation Guide - Detailed installation for all methods
• ⚙️ Provider Configuration - Complete setup for all 9+ providers
• 🎯 Quick Start Examples - Copy-paste configs

IDE & CLI Integration

• 🖥️ Claude Code CLI Setup - Connect Claude Code CLI
• 🤖 Codex CLI Setup - Configure OpenAI Codex CLI with config.toml
• 🎨 Cursor IDE Setup - Full Cursor integration with troubleshooting
• 🔍 Embeddings Guide - Enable @Codebase semantic search (4 options: Ollama, llama.cpp, OpenRouter, OpenAI)

Features & Capabilities

• ✨ Core Features - Architecture, request flow, format conversion
• 🧠 Memory System - Titans-inspired long-term memory
• 🗃️ Semantic Cache - Cache responses for similar prompts
• 💰 Token Optimization - 60-80% cost reduction strategies
• 🔧 Tools & Execution - Tool calling, execution modes, custom tools

Deployment & Operations

• 🐳 Docker Deployment - docker-compose setup with GPU support
• 🏭 Production Hardening - Circuit breakers, load shedding, metrics
• 📊 API Reference - All endpoints and formats

Support

• 🔧 Troubleshooting - Common issues and solutions
• ❓ FAQ - Frequently asked questions
• 🧪 Testing Guide - Running tests and validation

External Resources

• 📚 DeepWiki Documentation - AI-powered documentation search
• 💬 GitHub Discussions - Community Q&A
• 🐛 Report Issues - Bug reports and feature requests
• 📦 NPM Package - Official npm package

Key Features Highlights

• ✅ Multi-Provider Support - 9+ providers including local (Ollama, llama.cpp) and cloud (Bedrock, Databricks, OpenRouter)
• ✅ 60-80% Cost Reduction - Token optimization with smart tool selection, prompt caching, memory deduplication
• ✅ 100% Local Option - Run completely offline with Ollama/llama.cpp (zero cloud dependencies)
• ✅ OpenAI Compatible - Works with Cursor IDE, Continue.dev, and any OpenAI-compatible client
• ✅ Embeddings Support - 4 options for @Codebase search: Ollama (local), llama.cpp (local), OpenRouter, OpenAI
• ✅ MCP Integration - Automatic Model Context Protocol server discovery and orchestration
• ✅ Enterprise Features - Circuit breakers, load shedding, Prometheus metrics, K8s health checks
• ✅ Streaming Support - Real-time token streaming for all providers
• ✅ Memory System - Titans-inspired long-term memory with surprise-based filtering
• ✅ Tool Calling - Full tool support with server and passthrough execution modes
• ✅ Production Ready - Battle-tested with 400+ tests, observability, and error resilience
• ✅ Node 20-25 Support - Works with latest Node.js versions including v25
• ✅ Semantic Caching - Cache responses for similar prompts (requires embeddings)

Semantic Cache

Lynkr includes an optional semantic response cache that returns cached responses for semantically similar prompts, reducing latency and costs.

Enable Semantic Cache:

# Requires an embeddings provider (Ollama recommended)
ollama pull nomic-embed-text

# Add to .env
SEMANTIC_CACHE_ENABLED=true
SEMANTIC_CACHE_THRESHOLD=0.95
OLLAMA_EMBEDDINGS_MODEL=nomic-embed-text
OLLAMA_EMBEDDINGS_ENDPOINT=http://localhost:11434/api/embeddings

| Setting | Default | Description | |---------|---------|-------------| | SEMANTIC_CACHE_ENABLED | false | Enable/disable semantic caching | | SEMANTIC_CACHE_THRESHOLD | 0.95 | Similarity threshold (0.0-1.0) |

Note: Without a proper embeddings provider, the cache uses hash-based fallback which may cause false matches. Use Ollama with nomic-embed-text for best results.

Architecture

┌─────────────────┐
│    AI Tools     │  
└────────┬────────┘
         │ Anthropic/OpenAI Format
         ↓
┌─────────────────┐
│  Lynkr Proxy    │
│  Port: 8081     │
│                 │
│ • Format Conv.  │
│ • Token Optim.  │
│ • Provider Route│
│ • Tool Calling  │
│ • Caching       │
└────────┬────────┘
         │
         ├──→ Databricks (Claude 4.5)
         ├──→ AWS Bedrock (100+ models)
         ├──→ OpenRouter (100+ models)
         ├──→ Ollama (local, free)
         ├──→ llama.cpp (local, free)
         ├──→ Azure OpenAI (GPT-4o, o1)
         ├──→ OpenAI (GPT-4o, o3)
         └──→ Azure Anthropic (Claude)

📖 Detailed Architecture

Quick Configuration Examples

100% Local (FREE)

export MODEL_PROVIDER=ollama
export OLLAMA_MODEL=qwen2.5-coder:latest
export OLLAMA_EMBEDDINGS_MODEL=nomic-embed-text
npm start

💡 Tip: Prevent slow cold starts by keeping Ollama models loaded: launchctl setenv OLLAMA_KEEP_ALIVE "24h" (macOS) or set OLLAMA_KEEP_ALIVE=24h env var. See troubleshooting.

Remote Ollama (GPU Server)

export MODEL_PROVIDER=ollama
export OLLAMA_ENDPOINT=http://192.168.1.100:11434  # Any IP or hostname
export OLLAMA_MODEL=llama3.1:70b
npm start

🌐 Note: All provider endpoints support remote addresses - not limited to localhost. Use any IP, hostname, or domain.

MLX OpenAI Server (Apple Silicon)

# Terminal 1: Start MLX server
mlx-openai-server launch --model-path mlx-community/Qwen2.5-Coder-7B-Instruct-4bit --model-type lm

# Terminal 2: Start Lynkr
export MODEL_PROVIDER=openai
export OPENAI_ENDPOINT=http://localhost:8000/v1/chat/completions
export OPENAI_API_KEY=not-needed
npm start

🍎 Apple Silicon optimized - Native MLX performance on M1/M2/M3/M4 Macs. See MLX setup guide.

AWS Bedrock (100+ models)

export MODEL_PROVIDER=bedrock
export AWS_BEDROCK_API_KEY=your-key
export AWS_BEDROCK_MODEL_ID=anthropic.claude-3-5-sonnet-20241022-v2:0
npm start

OpenRouter (simplest cloud)

export MODEL_PROVIDER=openrouter
export OPENROUTER_API_KEY=sk-or-v1-your-key
npm start

** You can setup multiple models like local models 📖 More Examples

Contributing

We welcome contributions! Please see:

• Contributing Guide - How to contribute
• Testing Guide - Running tests

License

Apache 2.0 - See LICENSE file for details.

Community & Support

• ⭐ Star this repo if Lynkr helps you!
• 💬 Join Discussions - Ask questions, share tips
• 🐛 Report Issues - Bug reports welcome
• 📖 Read the Docs - Comprehensive guides

Made with ❤️ by developers, for developers.