llm-load-balancer
v0.5.3
Published
A small service package allowing to perform load balancing of LLM prompts between models, regions and model hosting platforms
Maintainers
Readme
llm-load-balancer
A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.
Usage
npm install llm-load-balancer