@avi770/testteam
v3.2.0
Published
TestTeam — 120 learning agents with reputation scoring, persistent memory, and execution bridge
Maintainers
Readme
Autonomous multi-phase testing pipeline with 120 learning agents. Runs Alpha through Release (plus an opt-in Exploratory pass) with quality gates, self-healing fix loops, reputation scoring, persistent memory, and zero manual intervention.
Quick Start
# 1. Initialize in your project
npx testteam init
# 2. Configure (edit the generated config)
vi testteam.config.ts
# 3. Run
npx testteam --phase alphaThe init wizard auto-detects your framework, test runner, and scaffolds configuration.
Why TestTeam
- 4-phase pipeline + Exploratory -- Alpha, Beta, UAT, Release with quality gates that block promotion on failure, plus an opt-in autonomous Exploratory pass
- 120 specialized agents -- each owns a single testing concern (a11y, security, perf, visual regression, chaos, load testing, compliance, English-first E2E via Stagehand, autonomous exploration via Browser-Use, and more)
- Self-healing fix loop -- Healer and Fixer agents attempt automatic remediation before gate evaluation
- Visual regression -- pixel-level screenshot diffing with baseline management
- Cost-controlled -- per-run and per-agent budget limits with configurable abort/alert policies
- Framework-agnostic -- React, Next.js, Vue, Angular, NestJS, Express, or any project
Agent Roster
| # | Agent | Phase(s) | Tier | |---|-------|----------|------| | 1 | Analyst | Alpha | Free | | 2 | Seed Architect | Alpha | Free | | 3 | Test Generator | Alpha | Free | | 4 | Unit Runner | Alpha | Free | | 5 | Browser Crawler | Alpha, Beta, UAT | Free | | 6 | API Exerciser | Beta, UAT | Pro | | 7 | Security Scout | Beta | Pro | | 8 | A11y Guardian | Beta | Pro | | 9 | Healer | Fix Loop | Free | | 10 | Reporter | Release | Free | | 11 | Fixer | Fix Loop | Free | | 12 | UX Inspector | Beta, UAT | Pro | | 13 | Performance Profiler | Beta, UAT | Pro | | 14 | Data Integrity Auditor | Beta, UAT | Enterprise | | 15 | Regression Sentinel | Beta, UAT | Pro | | 16 | Chaos Agent | Beta | Enterprise | | 17 | Documentation Validator | UAT | Enterprise | | 18 | Integration Watchdog | Beta, UAT | Enterprise | | 19 | Tenant Isolation Auditor | Beta, UAT | Enterprise | | 20 | Workflow Completion Tester | UAT | Enterprise | | 21 | State/Session Tester | Beta, UAT | Pro | | 22 | Email & Notification Verifier | Beta, UAT | Pro | | 23 | Migration Tester | Alpha | Pro | | 24 | Signup & Onboarding Tester | Alpha | Pro | | 25 | CRUD Flow Tester | Beta, UAT | Pro | | 26 | Form Validator | Beta, UAT | Pro | | 27 | Search & Filter Tester | Beta, UAT | Pro | | 28 | Navigation & Routing Tester | Beta, UAT | Pro | | 29 | Responsive Interaction Tester | Beta, UAT | Pro | | 30 | Multi-User Scenario Tester | Beta, UAT | Enterprise | | 31 | Load Tester | Beta, UAT | Pro | | 32 | Memory Leak Detector | Beta, UAT | Pro | | 33 | Bundle Analyzer | Beta, UAT | Pro | | 34 | XSS Scanner | Beta | Enterprise | | 35 | CSRF Tester | Beta, UAT | Enterprise | | 36 | Auth Fuzzer | Beta | Enterprise | | 37 | Dependency Scanner | Alpha, Beta, UAT | Pro | | 38 | Secrets Scanner | Alpha, Beta, UAT | Pro | | 39 | API Contract Tester | Beta, UAT | Enterprise | | 40 | Rate Limit Tester | Beta | Enterprise | | 41 | API Pagination Tester | Beta, UAT | Enterprise | | 42 | GraphQL Tester | Beta, UAT | Enterprise | | 43 | Data Consistency Checker | Beta, UAT | Enterprise | | 44 | Backup Recovery Tester | Beta, UAT | Enterprise | | 45 | Data Privacy Scanner | Beta, UAT | Enterprise | | 46 | SEO Auditor | Beta, UAT | Pro | | 47 | Social Preview Tester | Beta, UAT | Enterprise | | 48 | Lighthouse Auditor | Beta, UAT | Pro | | 49 | i18n Tester | Beta, UAT | Enterprise | | 50 | Timezone Tester | Beta, UAT | Enterprise | | 51 | Error Recovery Tester | Beta, UAT | Enterprise | | 52 | Offline Mode Tester | Beta, UAT | Enterprise | | 53 | Graceful Degradation Tester | Beta, UAT | Enterprise | | 54 | WebSocket Tester | Beta, UAT | Enterprise | | 55 | Realtime Sync Tester | Beta, UAT | Enterprise | | 56 | File Upload Tester | Beta, UAT | Enterprise | | 57 | Export Tester | Beta, UAT | Enterprise | | 58 | Payment Flow Tester | Beta, UAT | Enterprise | | 59 | SSL/TLS Auditor | Beta, UAT | Enterprise | | 60 | DNS & CDN Tester | Beta, UAT | Enterprise | | 61 | Docker Health Checker | Beta, UAT | Enterprise | | 62 | Env Config Validator | Alpha, Beta, UAT | Pro | | 63 | Log Quality Auditor | Beta, UAT | Enterprise | | 64 | Analytics Tracker Tester | Beta, UAT | Enterprise | | 65 | GDPR Compliance Tester | Beta, UAT | Enterprise | | 66 | SOC2 Control Validator | Beta, UAT | Enterprise | | 67 | WCAG AAA Tester | Beta, UAT | Enterprise | | 68 | Dead Code Detector | Alpha, Beta, UAT | Pro | | 69 | Type Safety Auditor | Alpha, Beta, UAT | Pro | | 70 | Complexity Analyzer | Alpha, Beta, UAT | Pro | | 71 | Unit Testing Agent | Beta, UAT | Pro | | 72 | Integration Testing Agent | Beta, UAT | Pro | | 73 | System Testing Agent | Beta, UAT | Enterprise | | 74 | Acceptance Testing Agent | Beta, UAT | Pro | | 75 | Sanity Testing Agent | Alpha, Beta, UAT | Pro | | 76 | Regression Testing Agent | Beta, UAT | Pro | | 77 | Browser Load Testing Agent | Beta, UAT | Pro | | 78 | Stress Testing Agent | Beta | Enterprise | | 79 | Endurance Testing Agent | Beta, UAT | Enterprise | | 80 | Usability Testing Agent | Beta, UAT | Pro | | 81 | Compatibility Testing Agent | Beta, UAT | Pro | | 82 | Exploratory Testing Agent | Beta | Enterprise | | 83 | Static Analysis Agent | Alpha, Beta, UAT | Pro | | 84 | Governance Testing Agent | Beta, UAT | Enterprise | | 85 | Stagehand Agent | Beta, UAT | Pro | | 86 | Browser-Use Agent | Exploratory | Enterprise | | 87 | Connection Mapper | Alpha | Free | | 88 | Localhost Walkthrough | Alpha | Free | | 89 | Repair & Retest | Alpha | Free | | 90 | Response Shape Validator | Alpha | Free | | 91 | Boundary Fuzzer (opt-in) | Alpha | Free | | 92 | Repair Simulator | Alpha | Pro | | 93 | Env Var Auditor | Alpha | Free | | 94 | Schema Validator | Alpha | Free | | 95 | API Contract Drift | Alpha | Free | | 96 | Cookie Security Auditor | Alpha | Free | | 97 | Healthcheck Validator | Alpha | Free | | 98 | CORS / CSP Auditor | Alpha | Free | | 99 | Logging Hygiene Auditor | Alpha | Free | | 100 | Error-Handling Auditor | Alpha | Free | | 101 | Rate-Limit Auditor (opt-in) | Alpha | Free | | 102 | Dockerfile Auditor | Alpha | Free | | 103 | CI Workflow Auditor | Alpha | Free | | 104 | N+1 Query Detector | Alpha | Free | | 105 | Unbounded Query Auditor | Alpha | Free | | 106 | Hardcoded Config Auditor | Alpha | Free | | 107 | Open-Redirect Detector | Alpha | Free | | 108 | SQL Injection Detector | Alpha | Free | | 109 | Path Traversal Detector | Alpha | Free | | 110 | Mass-Assignment Detector | Alpha | Free | | 111 | Dynamic Code Execution Detector | Alpha | Free | | 112 | Cross-File Taint Tracker | Alpha | Free | | 113 | Response Contract Auditor | Alpha | Free | | 114 | Static A11y Auditor | Alpha | Free | | 115 | Multi-Hop Taint Tracker | Alpha | Free | | 116 | Runtime Contract Capture | Alpha | Free | | 117 | ARIA Rule Engine | Alpha | Free | | 118 | Insecure Crypto Auditor | Alpha | Free | | 119 | Hardcoded Secrets Scanner | Alpha | Free | | 120 | Async Safety Auditor | Alpha | Free |
Browser-agent layers (Sprint 4)
- Stagehand Agent (#85) — deterministic E2E in plain English. Runs locally
(no Browserbase cloud lock-in unless
BROWSERBASE_LOCAL=falseis set). Hard cost guard caps each test at $0.10 of LLM spend. Seedocs/agents/stagehand.md. - Browser-Use Agent (#86) — autonomous exploratory pass via a Python
FastAPI sidecar (
agents/browser-use-sidecar/server.py). Runs in the newexploratoryphase, gated byTF_BROWSER_USE_ENABLED=1, hard-capped at 10 000 LLM tokens per run. Seedocs/agents/browser-use.md.
v3.2.0 — Dashboard & Scale
TestTeam v3.2.0 makes every built capability visible and grows the roster to 120 agents:
- Dashboard layer-posture views (S2–S10) — each composite/operational layer is surfaced from a run's persisted findings via a bridge
GETendpoint + reader: Master-Knowledge blast-radius, the Sentinel (security), the Inspector (compliance), the Border Guard (api-contract), the Designer (a11y/usability), the Tech-Debt tracker, the Data-Integrity notary, the Reliability cluster (Tester verdict + DR resilience), and a structural Loop-Engine cockpit. Every view is honestly run-derived and discloses what needs live inputs — it never fabricates a posture. - Roster → 120 agents (agents 85–120) plus browser-agent layers.
- License go-live — the EC-P-256 trust anchor is baked into the shipped build, enabling paid-tier verification.
- Leaner package — the published npm artifact ships the compiled
dist/only (no raw TypeScript source or tests).
See CHANGELOG.md for the full history.
v3.0.0 — Learning Agents
TestTeam v3.0.0 introduces a learning layer that makes agents smarter over time:
- Total Recall — persistent memory stores findings, corrections, and context across runs. Agents recall past issues and avoid false positives.
- Agent-MVP — reputation scoring with tier progression (Rookie through Legend). High-performing agents earn trust; underperformers get coaching flags.
- MAH (Multi-Agent Hub) — orchestration layer supporting up to 100 concurrent agents with CustomExecutor and code-execution skills.
- Execution Bridge — pluggable executor system with PlaywrightPool (browser reuse), ShellExecutor (sandboxed commands), FileScanner (regex source scanning), and HttpClient (concurrent API testing).
Architecture
Total Recall (Memory)
|
Alpha --> [gate] --> Beta --> [gate] --> UAT --> [gate] --> Release
| | |
+------- Fix Loop (Healer + Fixer) ---+
| |
+---- Execution Bridge (Pool/Shell/HTTP/Scan) ----+
| |
+------------ Agent-MVP (Reputation) -------------+Each phase dispatches its agents, evaluates findings against blocking/advisory classification, and promotes to the next phase only if the gate passes. The fix loop runs automatically when agents detect issues. Agent performance is tracked by Agent-MVP and findings are persisted in Total Recall.
Pricing
| Plan | Price | Agents | Support | |------|-------|--------|---------| | Free | $0 | 41 agents | Community | | Pro | $299/mo | 78 agents | Priority email | | Enterprise | $999/mo | All 120 agents + custom | Dedicated support, SLA |
All plans include the CLI, init wizard, and config validation. Pro and Enterprise unlock the fix loop, Reporter, and advanced agents.
CI Integration
GitHub Actions
name: TestTeam
on: [push, pull_request]
jobs:
testteam:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: 20
- run: npm ci
- run: npx playwright install --with-deps
- run: npx testteam --phase all
env:
TF_ADMIN_EMAIL: ${{ secrets.TF_ADMIN_EMAIL }}
TF_ADMIN_PASSWORD: ${{ secrets.TF_ADMIN_PASSWORD }}CLI Reference
Usage: testteam [options]
Commands:
init Initialize TestTeam
Options:
--phase <alpha|beta|uat|release|exploratory|all>
Phase to run (exploratory is opt-in)
--dry-run Show dispatch plan without executing
--agent <id> Run a single agent by ID
--config <path> Path to config file
--recall <query> Query Total Recall memory
--reputation Show agent reputation leaderboard
--coaching <agentId> Show coaching flags for an agent
--help Show helpConfiguration
import type { TestTeamConfig } from 'testteam/config';
const config: TestTeamConfig = {
schemaVersion: 1,
name: 'my-app',
modules: [
{ id: 'dashboard', route: '/dashboard', sidebarIcon: true },
],
environments: {
alpha: { baseUrl: 'http://localhost:3000', seed: true },
beta: { baseUrl: 'https://staging.example.com', seed: false },
},
};
export default config;See the full configuration reference for all options including auth, breakpoints, cost budgets, thresholds, and agent classification.
Contributing
See CONTRIBUTING.md for setup instructions, how to create custom agents, code style, and PR workflow.
Documentation
Full docs: docs.testteam.dev
License
MIT -- Copyright 2026 BAS & More Pty Ltd
