Supatest AI CLI

AI agent for E2E tests - Build, debug, and fix tests with AI assistance

Overview

Supatest AI is an AI-powered CLI that helps you write and maintain E2E tests. Use it interactively to build tests from scratch, or integrate it into CI to automatically fix failing tests.

Features

• Build Tests - Describe what to test in natural language, get working tests
• Debug Failures - AI investigates and fixes failing tests
• Fix in CI - Pipe test logs and let AI fix issues automatically

Requirements

• Node.js 18+ - Download Node.js
• Supatest API Key - Get your key

Installation

npm install -g @supatest/cli

Or use npx without installing:

npx @supatest/cli

Usage

Interactive Mode

Run without arguments to start interactive mode:

supatest

On first run, type /login to authenticate with your Supatest account.

Then describe what you want to test:

> Write a test for the login flow
> Add a test that verifies users can add items to cart
> Test the checkout process with a valid credit card

Headless Mode (CI)

For CI/CD pipelines, set your API key and pass a task:

export SUPATEST_API_KEY="your-api-key"

# Fix failing tests from a log file
supatest "fix the failing tests" --logs test-output.log

# Pipe test output directly
npm test 2>&1 | supatest "fix any failures" --stdin

Options

supatest [task] [options]

Options:
  -l, --logs <file>       Path to log file to analyze
  --stdin                 Read logs from stdin
  --headless              Force headless mode (no interactive UI)
  -m, --max-iterations    Maximum AI turns (default: 100)
  -C, --cwd <path>        Working directory
  --verbose               Enable verbose logging
  -V, --version           Show version
  -h, --help              Show help

Commands:
  setup                   Check prerequisites and set up required tools

CI/CD Integration

GitHub Actions:

- name: Run tests
  id: tests
  continue-on-error: true
  run: npm test 2>&1 | tee test-output.log

- name: Fix failing tests
  if: steps.tests.outcome == 'failure'
  env:
    SUPATEST_API_KEY: ${{ secrets.SUPATEST_API_KEY }}
  run: npx @supatest/cli "fix the failing tests" --logs test-output.log

GitLab CI:

test:
  script:
    - npm test 2>&1 | tee test-output.log || true
    - npx @supatest/cli "fix failures" --logs test-output.log
  variables:
    SUPATEST_API_KEY: $SUPATEST_API_KEY

Support

• Documentation
• GitHub Issues

License

ISC