Hyperp - Fully Automated Pay-As-You-Go Compute Platform

hyperp is a fully automated serverless compute platform that runs on AWS. It follows fully GitOps model, handles CI/CD automatically, provides a storage mechanism for passing artifacts between jobs and downloading them, and gives cost estimation for compute and storage usages per run. You can easily interact with the platform using its CLI tool.

How it works

Setup instructions

Architecture Overview

Hyperp consists of the following components:

Infrastructure

• VPC: Large addressable VPC (10.0.0.0/16) with public subnets
• ECS Fargate Cluster: For running containerized jobs
• ECR Repository: For storing built Docker images
• EFS File System: For sharing artifacts between jobs
• DynamoDB: For storing workflow metadata, runs, and state
• S3 Bucket: For storing GitHub App credentials
• EventBridge: For tracking ECS task state changes

Lambda Functions

1. GitHub Webhook Handler: Processes commit events, syncs workflows, triggers runs
2. Task State Change Handler: Tracks ECS task completion, manages job dependencies
3. EFS Controller: Creates directories on EFS for artifact storage
4. CLI REST API: Provides REST API endpoints for the CLI tool to query workflow runs