llamanade
v0.1.0
Published
Interactive CLI to pick, download, and serve local LLMs (llama.cpp) tuned to your hardware.
Maintainers
Readme
llamanade
The tastiest way to serve local LLMs. An interactive CLI that picks, downloads, and runs local models (via llama.cpp) tuned to your hardware.
Install
npm install -g llamanadeOr run it without installing:
npx llamanadeUsage
llamanade # pick a downloaded model and start it
llamanade list # list available / downloaded models
llamanade download <model> # download a model by id
llamanade start # start the server
llamanade stop # stop the server
llamanade --help # full helpRunning llamanade with no arguments launches the interactive picker, which
reads your CPU/GPU/RAM and recommends models that fit.
Requirements
- Node.js >= 18
License
MIT
