@agentic-kernel/model-ondevice

On-device / small / local raw-text model Planner. Inject a TextGenerator (Ollama / llama.cpp / transformers); all weak-model resilience — tolerant JSON parsing, repair retries, plan-then-execute, self-consistency voting, verifiers — lives inside. Includes the createOnDeviceAgentEngine turnkey preset.

Part of Agentic Kernel — a microkernel agent runtime, feature-paired across TypeScript and Python.

Install

npm install @agentic-kernel/model-ondevice

Usage

import { createOnDeviceAgentEngine } from "@agentic-kernel/model-ondevice";

const engine = createOnDeviceAgentEngine({
  planner: { generate },          // your injected TextGenerator
  engine: { policy, toolRegistry }
});

See the documentation site for guides and the full API.

License

Apache-2.0