@infersec/conduit
v1.15.0
Published
End user conduit agent for connecting local LLMs to the cloud.
Downloads
1,731
Readme
@infersec/conduit
Conduit agent for connecting local LLMs to the Infersec cloud.
Usage
npx @infersec/conduit --engine <type> --key <api-key> --source <source-id>Flags
| Flag | Required | Default | Notes |
| ----------- | -------- | ------------------------------ | ------------------------------------------ |
| --engine | Yes | - | Engine type (matches ENGINE). |
| --key | Yes | - | API key (matches API_KEY). |
| --source | Yes | - | Inference source ID (matches SOURCE). |
| --api-url | No | https://api.infersec.ai | API base URL (matches API_URL). |
| --port | No | 9505 | Port to listen on (matches PORT). |
| --root | No | $HOME/.cache/infersec/iagent | Root directory (matches ROOT_DIRECTORY). |
Examples
| Scenario | Command |
| ---------------- | ------------------------------------------------------------------------------------------------------------ |
| Required only | npx @infersec/conduit --engine vllm --key <api-key> --source <source-id> |
| Custom root/port | npx @infersec/conduit --engine vllm --key <api-key> --source <source-id> --root /data/infersec --port 9506 |
Environment variables
| Variable | Required | Default | Notes |
| ---------------- | -------- | ------------------------------ | ----------------------------------------- |
| ENGINE | Yes | - | Engine type (matches --engine). |
| API_KEY | Yes | - | API key (matches --key). |
| SOURCE | Yes | - | Inference source ID (matches --source). |
| API_URL | No | https://api.infersec.ai | API base URL (matches --api-url). |
| PORT | No | 9505 | Port to listen on (matches --port). |
| ROOT_DIRECTORY | No | $HOME/.cache/infersec/iagent | Root directory (matches --root). |
CLI flags override environment variables when both are provided.
