substrai
v1.1.0
Published
Open-source GenAI frameworks for serverless infrastructure. Production-grade tools for AWS Lambda.
Downloads
153
Maintainers
Readme
SubstrAI
Open-source GenAI frameworks for serverless infrastructure.
This package is under active development. The first framework (LambdaLLM) will be released soon.
What is SubstrAI?
SubstrAI is an open-source initiative producing enterprise-grade GenAI frameworks purpose-built for AWS Lambda and serverless infrastructure.
We solve the fundamental incompatibility between existing LLM frameworks (LangChain, LlamaIndex) and AWS Lambda's stateless, cold-start-optimized, timeout-constrained execution model.
Planned Frameworks
| Framework | Description | Status | |-----------|-------------|--------| | LambdaLLM | Serverless-native LLM orchestration | In Development | | GuardrailGraph | Composable AI safety pipelines | Planned | | CostSentinel | Real-time GenAI cost governance | Planned | | PromptOps | Infrastructure-as-Code for prompts | Planned | | EvalForge | Automated LLM evaluation pipelines | Planned | | AgentDeploy | Zero-to-production agent deployment | Planned | | RAGForge | Enterprise RAG architecture generator | Planned |
Design Principles
- Lambda-first: Purpose-built for serverless constraints
- Convention over configuration: Works in 5 minutes with zero config
- Observable by default: Every action traceable without extra setup
- Cost-aware: Built-in budget enforcement and model routing
- Escape hatches: Never trap the user
Links
- GitHub: github.com/substrai
- Website: substrai.dev
Author
Gaurav Kumar Sinha — Founder, SubstrAI
- Email: [email protected]
- GitHub: github.com/substrai
License
MIT
