npm package discovery and stats viewer.

Discover Tips

  • General search

    [free text search, go nuts!]

  • Package details

    pkg:[package-name]

  • User packages

    @[username]

Sponsor

Optimize Toolset

I’ve always been into building performant and accessible sites, but lately I’ve been taking it extremely seriously. So much so that I’ve been building a tool to help me optimize and monitor the sites that I build to make sure that I’m making an attempt to offer the best experience to those who visit them. If you’re into performant, accessible and SEO friendly sites, you might like it too! You can check it out at Optimize Toolset.

About

Hi, 👋, I’m Ryan Hefner  and I built this site for me, and you! The goal of this site was to provide an easy way for me to check the stats on my npm packages, both for prioritizing issues and updates, and to give me a little kick in the pants to keep up on stuff.

As I was building it, I realized that I was actually using the tool to build the tool, and figured I might as well put this out there and hopefully others will find it to be a fast and useful way to search and browse npm packages as I have.

If you’re interested in other things I’m working on, follow me on Twitter or check out the open source projects I’ve been publishing on GitHub.

I am also working on a Twitter bot for this site to tweet the most popular, newest, random packages from npm. Please follow that account now and it will start sending out packages soon–ish.

Open Software & Tools

This site wouldn’t be possible without the immense generosity and tireless efforts from the people who make contributions to the world and share their work via open source initiatives. Thank you 🙏

© 2026 – Pkg Stats / Ryan Hefner

freellmapikey

v1.0.1

Published

One OpenAI-compatible endpoint. 18 free-tier providers. ~1.3B tokens/month.

Readme

FreeLLMAPIKey

One OpenAI-compatible endpoint. 18 integrated providers. ~1B+ tokens per month.

Fork notice: This repo is FreeLLMAPIKey (freellmapikey), a renamed fork of FreeLLMAPI by Tashfeen Ahmed. See CREDITS.md.

Aggregate the free tiers from Google, Groq, Cerebras, SambaNova, NVIDIA, Mistral, OpenRouter, GitHub Models, Cohere, Cloudflare, Hugging Face, Together AI, Z.ai (Zhipu), and AWS Bedrock behind a single /v1/chat/completions endpoint. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.

CI License: MIT PRs Welcome

Fallback chain with per-provider token budget


Credits

FreeLLMAPIKey is based on FreeLLMAPI by Tashfeen Ahmed. This fork uses the name freellmapikey so it is not confused with the upstream repository. Full attribution: CREDITS.md.

Contents

Why this exists

Every serious AI lab now offers a free tier — a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly 1.3 billion tokens per month of working inference capacity, across dozens of models from small-and-fast to reasonably capable.

The problem is that stacking them by hand is painful: many different SDKs, rate limits, and failure modes per vendor. FreeLLMAPIKey collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for.

Supported providers

Features

  • OpenAI-compatiblePOST /v1/chat/completions and GET /v1/models work with the official OpenAI SDKs and any OpenAI-compatible client (LangChain, LlamaIndex, Continue, Hermes, etc.). Just change base_url.
  • EmbeddingsPOST /v1/embeddings routes through Google (text-embedding-004, 768 dims, 1500 RPM free) and Mistral (mistral-embed, 1024 dims) with the same auto-fallback logic as chat. Works with model: "auto" or a specific model name. OpenAI-compatible response shape.
  • Responses API (Codex)POST /v1/responses with streaming SSE; Guides walk through local Codex config.toml and factory rollback.
  • Anthropic-compatiblePOST /v1/messages and POST /v1/messages/count_tokens for Claude Code CLI; Guides include local ANTHROPIC_BASE_URL setup and factory restore.
  • Streaming and non-streaming — Server-Sent Events for stream: true, JSON response otherwise. Every provider adapter implements both.
  • Tool calling — OpenAI-style tools / tool_choice requests are passed through, and assistant tool_calls + tool role follow-up messages round-trip across providers.
  • Vision (Codex & chat) — Pasted images in Codex (input_image on /v1/responses) and multimodal user messages on /v1/chat/completions are routed to vision-capable models (Gemini, Llama 4, etc.); text-only backends are skipped when images are present.
  • Automatic fallover — If the chosen provider returns a 429, 5xx, or times out, the router skips it, puts the key on a short cooldown, and retries on the next model in your fallback chain (up to 20 attempts).
  • Per-key rate tracking — RPM, RPD, TPM, and TPD counters per (platform, model, key) so the router always picks a key that's under its caps.
  • Sticky sessions — Multi-turn conversations keep talking to the same model for 30 minutes to avoid the hallucination spike that comes from mid-conversation model switches.
  • Encrypted key storage — API keys are encrypted with AES-256-GCM before hitting SQLite; decryption happens in-memory just before a request.
  • Unified API key — Clients authenticate to your proxy with a single freellmapikey-… bearer token. You never expose upstream provider keys to your apps.
  • Health checks — Periodic probes mark keys as healthy, rate_limited, invalid, or error so the router skips dead ones automatically.
  • Admin dashboard — React + Vite UI to manage keys, reorder the fallback chain, inspect analytics, and run prompts in a playground. Dark mode included.
  • Analytics — Per-request logging with latency, token counts, success rate, per-provider breakdowns, a usage log (timestamped successful routes), and a persistent error log for failures.
  • Deploys to a Raspberry Pi — Runs happily on a Pi 4 under PM2 behind nginx. ~40 MB RSS at idle.

Not yet supported

The scope is deliberately narrow. If a feature isn't on this list and isn't below, assume it isn't there yet.

  • Image generation (/v1/images/*)
  • Audio / speech (/v1/audio/*)
  • Legacy completions (/v1/completions) — only the chat endpoint is implemented
  • Moderation (/v1/moderations)
  • n > 1 (multiple completions per request)
  • Per-user billing / multi-tenant auth — single-user by design

PRs that add any of these are very welcome. See Contributing.

Quick start

Option A — zero-config npx (no git clone needed)

npx freellmapikey

The CLI clones the repo into ~/.freellmapikey, runs npm install && npm run build, and starts the server on :3001. On subsequent runs it skips setup and goes straight to start. Subcommands: setup, start, update.

Option B — clone and run

Prerequisites: Node.js 20+, npm.

git clone https://github.com/nalepy/freellmapikey.git
cd freellmapikey
npm install

# Generate an encryption key for at-rest key storage
cp .env.example .env
echo "ENCRYPTION_KEY=$(node -e "console.log(require('crypto').randomBytes(32).toString('hex'))")" >> .env

# Start server + dashboard together
npm run dev

Open http://localhost:5173 (the Vite dev UI), add your provider keys on the Keys page, reorder the Fallback Chain to taste, and grab your unified API key from Keys or Guides. Use Guides for VS Code (Continue, Cline), Claude Code CLI, Codex, and OpenAI-compatible clients — each integration has configure local proxy and restore factory sections where relevant.

Hugging Face, Together AI & AWS Bedrock

| Provider | Where to get a key | Notes | | --- | --- | --- | | Hugging Face | huggingface.co/settings/tokens | Create a token with Inference Providers permission (hf_…). Routed via https://router.huggingface.co/v1. | | Together AI | api.together.ai/settings/api-keys | Prepaid credits (often a $5 minimum top-up). OpenAI-compatible serverless models. | | AWS Bedrock | Bedrock console → API keys or IAM | On the Keys page: Region + Access Key ID + Secret Access Key (same as Cursor), or Region + a Bedrock API key (ABSK…) with Access Key ID left empty. IAM uses SigV4 on bedrock-runtime; API keys use Bearer on bedrock-mantle. Enable model access in your region; billed via AWS (credits / on-demand), not a standing free tier. |

For a production build:

npm run build
node server/dist/index.js     # server + dashboard both served on :3001

Using the API

Any OpenAI-compatible client works. Examples:

Chat completions

Python

from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:3001/v1",
    api_key="freellmapikey-your-unified-key",
)

resp = client.chat.completions.create(
    model="auto",  # let the router pick; or specify e.g. "gemini-2.5-flash"
    messages=[{"role": "user", "content": "Summarise the fall of Rome in one sentence."}],
)
print(resp.choices[0].message.content)
print("Routed via:", resp.headers.get("x-routed-via"))

curl

curl http://localhost:3001/v1/chat/completions \
  -H "Authorization: Bearer freellmapikey-your-unified-key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "auto",
    "messages": [{"role": "user", "content": "hi"}]
  }'

Streaming

stream = client.chat.completions.create(
    model="auto",
    messages=[{"role": "user", "content": "Stream me a haiku about SQLite."}],
    stream=True,
)
for chunk in stream:
    print(chunk.choices[0].delta.content or "", end="", flush=True)

Tool calling

Pass OpenAI-style tools and tool_choice; the assistant response round-trips back through the proxy exactly like the OpenAI API. Multi-step flows (assistant tool_callstool role follow-up → final answer) work across every provider the router can reach.

tools = [{
    "type": "function",
    "function": {
        "name": "get_weather",
        "description": "Get current weather for a city.",
        "parameters": {
            "type": "object",
            "properties": {"city": {"type": "string"}},
            "required": ["city"],
        },
    },
}]

# 1. Model asks for a tool call
first = client.chat.completions.create(
    model="auto",
    messages=[{"role": "user", "content": "What's the weather in Karachi?"}],
    tools=tools,
    tool_choice="required",
)
call = first.choices[0].message.tool_calls[0]

# 2. You execute the tool, feed the result back
final = client.chat.completions.create(
    model="auto",
    messages=[
        {"role": "user", "content": "What's the weather in Karachi?"},
        first.choices[0].message,
        {"role": "tool", "tool_call_id": call.id, "content": '{"temp_c": 32, "cond": "sunny"}'},
    ],
    tools=tools,
)
print(final.choices[0].message.content)

Works with stream=True as well — you'll get delta.tool_calls chunks followed by a finish_reason: "tool_calls" close. Under the hood, OpenAI-compatible providers (Groq, Cerebras, SambaNova, Mistral, OpenRouter, GitHub Models, Hugging Face, Together AI, Cloudflare, AWS Bedrock, Cohere compat) get the request passed through; Gemini requests get translated into Google's functionDeclarations / functionResponse shape and the response is translated back.

Every response carries an X-Routed-Via: <platform>/<model> header so you can see which provider actually served each call. If a request fell over between providers, you'll also see X-Fallback-Attempts: N.

Embeddings

POST /v1/embeddings — OpenAI-compatible. Routes through Google (text-embedding-004, 768 dims) and Mistral (mistral-embed, 1024 dims). Add a Google AI Studio key and/or a Mistral key on the Keys page to enable it.

| Model | Platform | Dims | Free limit | |---|---|---|---| | text-embedding-004 | Google | 768 | 1500 RPM, ~1M chars/day | | text-multilingual-embedding-002 | Google | 768 | 1500 RPM, ~1M chars/day | | mistral-embed | Mistral | 1024 | 2 RPM, 500k TPM (experiment tier) |

from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:3001/v1",
    api_key="freellmapikey-your-unified-key",
)

# Single string — routed to Google text-embedding-004 by default
resp = client.embeddings.create(model="auto", input="Hello, world")
print(len(resp.data[0].embedding))  # 768

# Batch
resp = client.embeddings.create(
    model="text-embedding-004",
    input=["first doc", "second doc"],
)
for item in resp.data:
    print(item.index, len(item.embedding))
curl http://localhost:3001/v1/embeddings \
  -H "Authorization: Bearer freellmapikey-your-unified-key" \
  -H "Content-Type: application/json" \
  -d '{"model": "auto", "input": "Hello, world"}'

Routing priority: model="auto" (or omitted) tries Google first, then Mistral. A specific Google model name (text-embedding-*, text-multilingual-*) goes straight to Google; mistral-embed goes straight to Mistral. If the first provider has no healthy key or is on cooldown after a 429, the route falls through to the next one automatically.

Claude Code (CLI — local proxy or factory)

The Guides tab documents both setups. CLI only — Claude Desktop cannot override ANTHROPIC_BASE_URL.

Configure local proxy (terminal claude command):

export ANTHROPIC_BASE_URL="http://localhost:3001"
export ANTHROPIC_API_KEY="freellmapikey-your-unified-key-from-dashboard"
claude
$env:ANTHROPIC_BASE_URL = "http://localhost:3001"
$env:ANTHROPIC_API_KEY = "freellmapikey-your-unified-key-from-dashboard"
claude

Optional ~/.claude/settings.json (or %USERPROFILE%\.claude\settings.json on Windows) with the same env keys. If you see a claude.ai token conflict, run /logout in the CLI first. Test with Reply with exactly: freellmapikey-OK and confirm Analytics → Usage log.

Restore factory Anthropic routing: unset ANTHROPIC_BASE_URL and remove the FreeLLMAPIKey value from ANTHROPIC_API_KEY / settings.json env, then use Anthropic or claude.ai sign-in as usual. Usage log should stay empty for Claude when traffic is off the proxy.

Continue (VS Code)

The Continue extension uses OpenAI Chat Completions. Point it at FreeLLMAPIKey with provider: openai and apiBase set to your local /v1 URL (this repo recommends the extension in .vscode/extensions.json).

  1. Start FreeLLMAPIKey and add provider keys on the Keys page.
  2. Copy your unified key (freellmapikey-…).
  3. Edit Continue config: VS Code → Continue chat → configs dropdown (top right) → cog beside Local Config, or open the file directly:
    • Windows: %USERPROFILE%\.continue\config.yaml
    • macOS / Linux: ~/.continue/config.yaml
  4. Add FreeLLMAPIKey to config.yaml (see below), save, and reload the VS Code window if the model does not appear (Developer: Reload Window). Select FreeLLMAPIKey in Continue’s model/config dropdown before chatting.

Already have a Continue config? Do not replace the whole file. Keep your existing top-level name, version, schema, context, rules, and other models entries. Append one new list item under models: (there must be only one models: key in the file). Replace the entire file only if you want FreeLLMAPIKey as your sole model.

Existing config — append under models::

  - name: FreeLLMAPIKey
    provider: openai
    model: auto
    apiBase: http://localhost:3001/v1
    apiKey: freellmapikey-your-unified-key-from-dashboard
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
    defaultCompletionOptions:
      temperature: 0.7
      maxTokens: 4096

New install — full config.yaml:

name: FreeLLMAPIKey (local)
version: 1.0.0
schema: v1
models:
  - name: FreeLLMAPIKey
    provider: openai
    model: auto
    apiBase: http://localhost:3001/v1
    apiKey: freellmapikey-your-unified-key-from-dashboard
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
    defaultCompletionOptions:
      temperature: 0.7
      maxTokens: 4096

Use model: auto to follow your dashboard fallback chain, or a slug from GET http://localhost:3001/v1/models (e.g. gemini-2.5-flash). tool_use enables Continue Agent mode when the routed backend supports tools. Verify with a short chat message, then check Analytics → Usage log for a new row (x-routed-via on HTTP responses shows the actual provider). Continue does not use Codex’s /v1/responses or Claude’s /v1/messages. See the config.yaml reference and the copy-paste blocks on the dashboard Guides tab.

Cline (VS Code)

The Cline extension (also in .vscode/extensions.json) uses an OpenAI Compatible provider and POST /v1/chat/completions with tool calling for its agent loop.

  1. Start FreeLLMAPIKey and add provider keys on the Keys page.
  2. Copy your unified key (freellmapikey-…).
  3. Open the Cline panel → Settings (gear) → set API Provider to OpenAI Compatible.
  4. Set Base URL to http://localhost:3001/v1, API Key to your unified key, and Model ID to auto (or a slug from GET http://localhost:3001/v1/models).
  5. Use Verify if offered, send a test message, then check Analytics → Usage log.

If Plan and Act modes show separate model fields, set both to auto or the same slug. Docs: OpenAI Compatible provider. Full steps are on the dashboard Guides tab.

OpenAI Codex (local proxy or factory)

Configure local proxy: set CUSTOM_API_KEY to your unified key, then edit ~/.codex/config.toml (Codex → Settings → Open config.toml):

model_provider = "freellmapikey"
model = "auto"

[model_providers.freellmapikey]
name = "FreeLLMAPIKey (local)"
base_url = "http://localhost:3001/v1"
env_key = "CUSTOM_API_KEY"
wire_api = "responses"
requires_openai_auth = false

Optional: sync ~/.codex/freellmapikey-models.json from the dashboard Guides tab or npm run codex:model-catalog. Restart Codex after saving.

Restore factory OpenAI routing: remove [model_providers.freellmapikey], set model_provider = "openai", unset CUSTOM_API_KEY, sign in with OpenAI in Codex, quit and reopen. See Codex configuration and the Guides tab for full snippets.

Screenshots

Keys

Manage provider credentials and grab the unified API key your apps connect with. Each key shows a status dot and when it was last health-checked.

Keys page

Playground

Send a chat completion through the router and see which provider served it, with the model ID and latency printed right on the message.

Playground page

Analytics

Request volume, success rate, tokens in and out, average latency, and per-provider breakdowns over 24h / 7d / 30d windows.

  • Usage log — Scrollable table of each successful routed request (newest first): local timestamp, provider, model, vision flag, input/output tokens, and latency. Use it to confirm Continue, Cline, Playground, or other OpenAI-compatible clients are hitting the proxy. Cleared when you Reset analytics.
  • Error log (debug) — Detailed failure rows (endpoint, retry, vision flags, full message) plus server/data/error.log. Kept when you reset analytics so you can still debug.

API: GET /api/analytics/usage-log?range=7d&limit=100 (same range as other analytics endpoints: 24h, 7d, 30d).

Analytics page

How it works

┌──────────────────┐   Bearer freellmapikey-…   ┌─────────────────────────┐
│  OpenAI SDK /    │ ──────────────────────▶ │  Express proxy (:3001)  │
│  curl / any      │ ◀────────────────────── │  /v1/chat/completions   │
│  OpenAI client   │      streamed tokens    └────────────┬────────────┘
└──────────────────┘                                      │
                                                          ▼
                             ┌────────────────────────────────────────────────┐
                             │  Router                                        │
                             │   1. Pick highest-priority model that          │
                             │      (a) has a healthy key and                 │
                             │      (b) is under all its rate limits.         │
                             │   2. Decrypt key, call provider SDK.           │
                             │   3. On 429/5xx → cooldown + retry next model. │
                             └────────────────────────────────────────────────┘
                                          │
   ┌──────────────┬────────────┬──────────┴─────────┬─────────────┬──────────┐
   ▼              ▼            ▼                    ▼             ▼          ▼
 Google         Groq        Cerebras           OpenRouter   Hugging Face  Together AI  Bedrock  …more
  • Router (server/src/services/router.ts) — picks a model per request.
  • Rate-limit ledger (server/src/services/ratelimit.ts) — in-memory RPM/RPD/TPM/TPD counters backed by SQLite, with cooldowns on 429s.
  • Provider adapters (server/src/providers/*.ts) — one file per provider, implementing the BaseProvider class: chatCompletion(), streamChatCompletion(), and optionally embeddings().
  • Health service (server/src/services/health.ts) — periodic probe keeps key status fresh.
  • Dashboard (client/) — React + Vite + shadcn/ui admin surface.
  • Storage — SQLite (better-sqlite3) with AES-256-GCM envelope encryption for keys.

Limitations

Stacking free tiers has real trade-offs. Be honest with yourself about them:

  • No frontier models. The free-tier catalog tops out around Llama 3.3 70B, GLM-4.5, Qwen 3 Coder, and Gemini 2.5 Pro. You will not get GPT-5 or Claude Opus class reasoning through this. For hard problems, pay for a real API.
  • Intelligence degrades as the day progresses. Your top-ranked models (usually Gemini 2.5 Pro, GPT-4o via GitHub Models) have the lowest daily caps. Once they hit their limits, the router falls down your priority chain to smaller/weaker models. Expect the effective intelligence of the endpoint to drop in the late hours of each day — then reset at UTC midnight.
  • Latency is highly variable. Cerebras and Groq are extremely fast; others are not. You get whichever one is available.
  • Free tiers can change without notice. Providers regularly tighten, loosen, or remove free tiers. When that happens you'll see 429s or auth errors until you update the catalog. Re-seed scripts live in server/src/scripts/.
  • Credit-based providers. Hugging Face Inference Providers and Together AI use small prepaid credit pools (not unlimited monthly free RPM like Groq). AWS Bedrock bills through your AWS account (new-account credits or on-demand). Budget rows in the dashboard reflect that.
  • No SLA, by definition. If you need reliability, use a paid provider with a contract.
  • Local-first. There's no multi-tenant auth. Run this for yourself; don't expose it to the internet.

Contributing

Contributors very welcome! Good first PRs:

  • Add a provider — copy server/src/providers/openai-compat.ts as a template, wire it into server/src/providers/index.ts, seed its models in server/src/db/index.ts, add a test in server/src/__tests__/providers/.
  • Add an endpoint — images, audio, moderations. The provider base class already has embeddings() as a model; follow the same pattern for new endpoint types.
  • Improve the router — cost-aware routing (cheapest-healthy-fastest tradeoffs), better latency-weighted priority, regional pinning.
  • Dashboard polish — charts on the Analytics page, key rotation UX, batch import of keys from .env.
  • Docs — more examples, client library snippets for Go/Rust/etc., a deployment recipe for Docker or Fly.

Development loop:

npm install
npm run dev      # server on :3001, dashboard on :5173, both with HMR
npm test         # vitest — 75 tests across providers, routes, router, ratelimit

PRs should include a test, keep the existing test suite green, and match the .editorconfig / tsconfig defaults already in the repo. Issues and discussions are open.

Contributors

Thanks to everyone who's helped improve FreeLLMAPIKey:

  • @moaaz12-web — tool-calling support across providers (#3)
  • @lukasulc — better-sqlite3 bump to fix npm install on Node 24+ (#12)
  • @VinhPhamAI — root .env PORT now propagates to server + Vite dev proxy + UI base URL (#27)
  • @deadc — preserve Gemini thoughtSignature so multi-turn function calling stops 400-ing (#32); router model-first key-exhaustion tests + per-model limits hoist (#42)
  • @zhangyu1324 — requested Ollama Cloud integration, now V10 catalog (#14 / #41)
  • @jtbrennan-git — security review (#35) and Phase 1 hardening: parameterized analytics queries, sort-preset whitelist, timing-safe API key compare, mid-stream error sanitization
  • @praveenkumarpranjal — guard Gemini SSE JSON.parse so a malformed frame no longer aborts the whole stream, plus first streaming tests for the Google provider (#47)

Terms of Service review

A self-hosted, single-user, personal-use setup was re-reviewed against each provider's ToS (May 2026). Summary:

| Provider | Verdict | Notes | |---|---|---| | Google Gemini | ⚠️ Caution | March 2026 ToS narrows scope to "professional or business purposes, not for consumer use" — a self-hosted developer proxy is still defensible, but the clause is new. | | Groq | ✅ Likely OK | GroqCloud Services Agreement permits Customer Application integration. | | Cerebras | ✅ Likely OK | Permitted; explicitly forbids selling/transferring API keys. | | Mistral | ✅ Likely OK | APIs allowed for personal/internal business use. | | OpenRouter | ✅ Likely OK | April 2026 ToS sharpens the no-resale / no-competing-service clause; private single-user proxy still fine. | | SambaNova | ⚠️ Ambiguous | EULA §1.5(c) blocks resale and "service bureau" use; single-user with no third-party access is fine. | | Cloudflare Workers AI | ⚠️ Ambiguous | No anti-proxy clause; covered by general Self-Serve Subscription Agreement. | | NVIDIA NIM | ⚠️ Caution | Trial ToS §1.2 / §1.4: "evaluation only, not production." Disabled in default catalog. | | GitHub Models | ⚠️ Caution | Free tier explicitly scoped to "experimentation" and "prototyping." | | Cohere | ❌ Avoid | Terms §14 still forbids "personal, family or household purposes." | | Zhipu (open.bigmodel.cn) | ✅ Likely OK | Personal/non-commercial research carve-out still in the platform docs. | | Z.ai (api.z.ai) | ⚠️ Caution | New row — Singapore entity (distinct from Zhipu CN). §III.3(l) anti-traffic-redirect clause could plausibly be read against a proxy; no explicit personal-use carve-out. | | Ollama Cloud | ✅ Likely OK | Free plan permits cloud-model access (1 concurrent, 5-hour session caps). No anti-proxy / anti-resale clauses found. | | Hugging Face | ⚠️ Caution | Inference Providers credits (~$0.10/mo free tier); routed via router.huggingface.co OpenAI API. Legacy Fireworks-route model removed in V4 (broken tool calls). | | Together AI | ⚠️ Caution | Prepaid credits only ($5 minimum purchase since July 2025); signup promos may apply. Serverless API permits customer-application integration. | | AWS Bedrock | ⚠️ Caution | Not a recurring free tier — AWS account billing. OpenAI-compatible Chat Completions via Bedrock Mantle / Runtime. Personal proxy use is fine if you comply with AWS Service Terms and enable only models you have rights to invoke. |

Rules of thumb that keep most providers happy: one account per provider, no reselling, no sharing your endpoint with other humans, don't hammer a free tier as a paid production backend. This is informational, not legal advice — read each provider's ToS and make your own call.

Removed from the catalog (April 2026 review): Moonshot and MiniMax direct integrations (Moonshot — paid-only; MiniMax — use OpenRouter minimax/minimax-m2.5:free). Hugging Face was re-added in V13 via the Inference Providers router with new model ids (the old Fireworks-route Llama row failed structured tool calls).

Disclaimer

This project is for personal experimentation and learning, not production. Free tiers exist so developers can prototype against them; they aren't a stable, supported inference substrate and shouldn't be treated as one. If you build something real on top of FreeLLMAPIKey, swap in a paid API before you ship. Your relationship with each upstream provider is governed by the terms you accepted when you created your account — those terms still apply when the traffic is proxied through this project, and you're responsible for complying with them.

License

MIT