gille-inference

A zero-dependency terminal client for inference.gille.ai — the gille.ai local inference gateway. Redeem an invite code, list available models, chat with streaming output, and check your credit usage.

Requires Node 18+ (uses built-in fetch). No external dependencies.

Install

npm install -g gille-inference

Or zero-install with npx:

npx gille-inference ask "What is the capital of France?"

Alternatively, download directly from the gateway:

curl -fsSL https://inference.gille.ai/hs -o ~/bin/hs && chmod +x ~/bin/hs

Quickstart

# 1. Redeem your invite code — saves credentials to ~/.config/hs/config.json
hs redeem inv_xxxxxxxxxxxxxxxx

# 2. List the models your key may use
hs models

# 3. Ask a question (streams tokens as they arrive)
hs ask "What is the capital of France?"
hs ask -m qwen3.5-35b-a3b --system "You are a code reviewer." "Review this: ..."

# 4. Check your tier, allowed models, and credit usage
hs usage

# 5. Show stored credentials
hs whoami

How it works

hs ask calls POST /v1/chat/completions with stream: true. hs models calls GET /v1/models. hs usage calls GET /portal/me. The gateway is plain OpenAI-compatible — you can swap hs for any OpenAI SDK at any time by pointing it at https://inference.gille.ai/v1.

More

Visit inference.gille.ai for the full portal, invite codes, and docs.