@helicone/helix
v0.1.0
Published
A high-performance LLM proxy router for load balancing, monitoring, and managing API requests to various language model providers
Keywords
Readme
Helicone Router
Local Development Setup Instructions
Install Rust: https://www.rust-lang.org/tools/install
Install Rust analyzer for your IDE.
Setup the
--all-featuresflag for your IDE. E.g. for VSCode, go to user preferences (cmd+shift+p), and add the line:"rust-analyzer.cargo.features": "all"to your preferences JSON.Create a Helicone API key for your Helicone user.
cp .env.template .envand fill out thePROXY__HELICONE__API_KEY,HELICONE_API_KEY,OPENAI_API_KEY, andANTHROPIC_API_KEYenvironment variables, and any others where your local environment does not match the default Helicone configuration.Start the docker compose stack:
cd infrastructure && docker compose up -dStart the router (from the root of the repo):
- with default configs:
cargo run - with a dev config file:
cargo rl
- with default configs:
Run an HTTP request against the router:
cargo run -p test, this is the package inscripts/test/src/main.rsand will eventually be removed or upgraded to a CLI.Run unit + integration tests:
cargo int-testTODO: which various homebrew packages are needed? tls, protoc, etc
