pi-llama-cpp-stats
v0.1.6
Published
Shows prompt processing progress from llama.cpp's SSE stream
Readme
pi-llama-cpp-stats
Pi extension that shows real-time prompt processing statistics from llama.cpp's SSE stream.
Features
- Replaces the "Working..." text with a live progress bar during prompt processing
- Shows progress percentage, estimated time remaining, and tokens/second
Example display:
Prefilling... ████████░░░░░░░░░░░░ 40% · 30s · 1234 tok/sInstallation
pi install npm:pi-llama-cpp-statsOr install locally for the current project:
pi install npm:pi-llama-cpp-stats -lUsage
- Restart pi (or
/reload) - Start a chat with a llama.cpp model
- The "Working..." text will be replaced with a live progress bar during prefilling
Requirements
- llama.cpp with OpenAI-compatible API
- llama.cpp must be built with
prompt_progresssupport (enabled by default in recent versions)
