ai.matey.native.node-llamacpp
v0.2.0
Published
node-llamacpp native backend for AI Matey
Maintainers
Readme
ai.matey.native.node-llamacpp
Native llama.cpp integration via node-llama-cpp
Part of the ai.matey monorepo.
Installation
npm install ai.matey.native.node-llamacppRequirements
Node.js 18+
GGUF model file
Quick Start
import { NodeLlamaCppBackend } from 'ai.matey.native.node-llamacpp';
const backend = new NodeLlamaCppBackend({
// configuration
});Exports
NodeLlamaCppBackend
License
MIT - see LICENSE for details.
