@mmmbuto/llama-cpp-termux-bonsai-tensor-vulkan
v0.10663.0-termux.1-bonsai-tensor-vulkan
Published
PrismML Bonsai-capable llama.cpp runtime for Android Termux arm64, Tensor and Vulkan Mali profile.
Maintainers
Readme
@mmmbuto/llama-cpp-termux-bonsai-tensor-vulkan
PrismML Bonsai-capable llama.cpp runtime for Android Termux arm64/Tensor
with Vulkan offload for the Pixel 9 Pro Mali-G715 GPU.
This is a separate next candidate. It installs namespaced launchers:
llama-cli-bonsai-tensor-vulkanllama-server-bonsai-tensor-vulkanllama-bench-bonsai-tensor-vulkan
The runtime is built with the Tensor CPU backend and Vulkan. The Pixel runtime
must report Mali-G715; llvmpipe/software Vulkan is not an acceptable result.
Keep the screen on and the app in the foreground during GPU smoke tests.
