@llmrtc/llmrtc-provider-lmstudio
v1.0.0
Published
LMStudio local LLM adapter for @llmrtc/LLMRTC
Readme
@llmrtc/llmrtc-provider-lmstudio
LM Studio local LLM provider for LLMRTC.
Installation
npm install @llmrtc/llmrtc-provider-lmstudioUsage
import { LMStudioLLMProvider } from '@llmrtc/llmrtc-provider-lmstudio';
const llm = new LMStudioLLMProvider({
baseUrl: 'http://localhost:1234/v1',
model: 'local-model'
});Features
- Connect to local LM Studio server
- OpenAI-compatible API
- Run models locally without API keys
- Privacy-focused inference
Documentation
Full documentation: https://www.llmrtc.org
License
Apache-2.0
