switcher-core
v1.0.0
Published
Switcher core routing and provider logic for AI model selection.
Maintainers
Readme
@switcher/core
Switcher core routing and provider logic for AI model selection.
Install
npm install @switcher/coreUsage
import { routeRequest, Provider, RequestContext } from '@switcher/core';
const providers: Provider[] = [/* ... */];
const metrics = new Map();
const context: RequestContext = {
model: 'gpt-4',
payload: { messages: [{ role: 'user', content: 'Hello!' }] },
userId: 'user-123',
};
const selected = routeRequest(providers, metrics, context);
console.log('Selected provider:', selected);API
Functions
routeRequest(providers, metrics, context)— Selects the best provider for a given request.routeRequestWithRankings(providers, metrics, rankings, context)— Selects provider using additional ranking info.
Types
Provider— Provider infoProviderMetrics— Metrics for providersProviderRanking— Ranking infoRequestContext— Inbound request context
License
MIT
