offrouter-llama-cpp
v0.34.0
Published
llama.cpp provider package for OffRouter.
Readme
offrouter-llama-cpp
llama.cpp provider package for OffRouter.
Install
npm install offrouter-llama-cppUsage
import { createLlamaCppAdapter } from "offrouter-llama-cpp";
const adapter = createLlamaCppAdapter({
baseUrl: process.env.LLAMACPP_BASE_URL,
});Provider activation names: LLAMACPP_BASE_URL, LLAMA_CPP_BASE_URL.
The package delegates transport and policy behavior to offrouter-core.
