infer-huggingface
v1.0.1
Published
infer llms from huggingface
Readme
infer-huggingface
Easiest way to infer your favourite LLMS from huggingface
REQUIREMENTS:
- HF_TOKEN
HOW TO USE:
infer.infer_llama("HF_TOKEN", "Hi").then(response => {
console.log(response);
}).catch(err => {
console.error(err);
});