@freeloaderapi/core
v0.3.0
Published
Core resilience, caching, and routing logic for the Freeloader AI Gateway.
Readme
@freeloaderapi/core
Core routing and resilience logic for the Freeloader AI Gateway.
This package contains the essential components for building highly available, multi-provider AI applications:
- Provider Selection: intelligent quota-aware routing across multiple free tiers.
- Circuit Breakers: automatic failover and sandboxing for unstable providers.
- Health Scoring: Redis-backed monitoring of provider latency and error rates.
- Rate Limiting & Deduplication: preventing quota abuse and caching identical requests.
Installation
npm install @freeloaderapi/coreUsage
This library is designed to be used internally by the Freeloader Gateway, but can be imported into custom applications.
See the main Freeloader Repository for full documentation.
