Nia Web Evaluation Agent

A powerful AI-powered browser testing tool for automatically testing web applications. This agent uses browser automation to analyze UI/UX, inspect network traffic via Chrome DevTools, and provide detailed reports.

Features

• UI/UX Testing: Analyzes user interfaces and experiences
• Chrome DevTools Integration: Inspects network traffic and API calls
• Error Detection: Identifies JavaScript errors, API issues, and visual problems
• Comprehensive Reporting: Provides detailed reports with screenshots and recommendations

Integration with Nia

The Web Evaluation Agent is integrated with Nia's API key system, allowing seamless authentication and usage tracking for your account.

Usage

API Endpoints

The agent can be accessed through the following REST API endpoints:

• POST /api/web-eval: Start a new web evaluation session
• DELETE /api/web-eval/{process_id}: Stop an active evaluation session
• GET /api/web-eval/status/{process_id}: Check the status of a session

Starting a Web Evaluation Session

import requests

# Start a web evaluation session
response = requests.post(
    "https://api.nia.dev/api/web-eval",
    json={
        "api_key": "your_nia_api_key",
        "run_background": True  # Run in background
    }
)
process_id = response.json()["process_id"]

MCP Server Usage

The Web Evaluation Agent runs as an MCP server and provides two main tools:

1. web_eval_agent: Evaluates the UX/UI of a web application
2. browser_login_setup: Sets up browser state for authenticated testing

Example tool usage:

# Web Evaluation
result = web_eval_agent(
    url="http://localhost:3000",
    task="Test the login flow and verify that error messages are displayed correctly",
    headless_browser=False
)

# Setup Browser State
result = browser_login_setup(
    url="http://localhost:3000/login"
)

Environment Variables

• NIA_API_KEY: Your Nia API key for authentication
• USE_LOCAL_BACKEND: Set to "true" to use a local backend (default: false)
• NIA_BACKEND_URL: URL of the Nia backend (default: https://api.nia.dev)

Requirements

• Python 3.10+
• Chrome or Chromium browser
• mcp-python
• browser-use library