@workglow/node-llama-cpp

node-llama-cpp provider for @workglow/ai.

Features

• Integration with node-llama-cpp for Workglow AI tasks
• Supports standard Workglow AI task interfaces
• Works seamlessly with @workglow/task-graph and @workglow/ai
• Built-in job queue support for rate limiting and concurrency

Installation

npm install @workglow/node-llama-cpp
# or
bun add @workglow/node-llama-cpp
# or
yarn add @workglow/node-llama-cpp

Usage

import { registerNodeLlamaCpp } from "@workglow/node-llama-cpp/ai-runtime";
import { TextGenerationTask } from "@workglow/ai";
import { Workflow } from "@workglow/task-graph";

// 1. Register the provider
await registerNodeLlamaCpp();

// 2. Use it in a workflow
const workflow = new Workflow();
workflow.add(new TextGenerationTask({
  model: "default-model",
  prompt: "Hello world!"
}));

const result = await workflow.run();

License

Apache 2.0 - See LICENSE for details.