@zoomci/testrunner

AI TestHub test execution engine — runs locally, manages Playwright browser sessions, and reports results to AI TestHub.

Features

• Regression Mode — batch-execute canonical test cases from TestHub
• Chat Mode — interactive NL-to-Playwright conversational testing
• Browser Pool — named/isolated Playwright sessions with auto-login
• LLM Translation — natural language → Playwright actions (Anthropic / OpenAI / Ollama)
• Web UI — real-time chat interface at localhost:4000
• TestHub Integration — auto-reports results, screenshots, and AI diagnosis

Quick Start

npm install -g @zoomci/testrunner
npx playwright install chromium

# Initialize config
testhub-runner init

# Start Web UI + API server
testhub-runner start

# Run regression tests
testhub-runner run -v v1.0.0

# Interactive chat mode
testhub-runner chat

Configuration

testhub-runner init creates testhub-runner.config.json:

{
  "testhub_url": "https://your-testhub-instance.com",
  "api_key": "testhub_pk_...",
  "llm": {
    "provider": "anthropic",
    "api_key": "sk-ant-...",
    "model": "claude-sonnet-4-20250514"
  },
  "sessions": {
    "admin": {
      "base_url": "https://your-app.com",
      "login": {
        "url": "/login",
        "username_selector": "#username",
        "password_selector": "#password",
        "submit_selector": "button[type=submit]",
        "success_indicator": ".dashboard",
        "credentials": { "username": "admin", "password": "***" }
      }
    }
  },
  "browser": {
    "headless": true,
    "viewport": { "width": 1280, "height": 720 }
  }
}

CLI Commands

| Command | Description | |---------|-------------| | testhub-runner init | Create config file interactively | | testhub-runner start [-p port] | Start Web UI + API (default: 4000) | | testhub-runner run -v <version> [-m module...] | Run regression tests | | testhub-runner chat [-s session] | Interactive chat mode |

Requirements

• Node.js >= 20
• Playwright (npx playwright install chromium)
• AI TestHub instance with API key

License

MIT