@loadmill/droid-cua
v2.2.2
Published
AI-powered Android testing agent using OpenAI's computer-use model and ADB
Readme
droid-cua
AI-powered mobile testing desktop app for Android and iOS
Create, run, and manage mobile tests with natural language. The desktop app guides setup, connects to your target device or simulator, and turns AI exploration into reusable test scripts.
https://github.com/user-attachments/assets/b9e15a1d-8072-4a2f-a4c5-db180ae38620
droid-cua is a desktop app for AI-powered mobile testing.
It helps teams create, edit, and run tests for Android devices and emulators and iOS simulators on macOS using natural language instead of traditional test code.
Under the hood, droid-cua uses an AI agent to explore your app, execute actions, and save reusable test scripts that can also be run later in headless workflows.
1. Download the desktop app
2. Launch the app
Open the desktop app and choose the platform you want to test.
3. Add your credentials
Set your OpenAI API key in the app Settings screen, or log in with your Loadmill account.
4. Connect a target device
- Android: connect a device or select an emulator
- iOS: choose a simulator on macOS
5. Create or run a test
Use the desktop app to create a new test, edit an existing one, or run a saved script with live execution logs.
You can also keep project run history in a results folder and review past runs from desktop app reports.
- Android - Physical devices and emulators
- iOS - Simulators on macOS
Requirements
All platforms:
- OpenAI API key
Android:
- Android Debug Bridge (ADB)
- Android Emulator CLI for launchable emulators
iOS (macOS only):
- Xcode with iOS Simulator
- Appium
- XCUITest driver
- Desktop-first workflow - Create, run, and manage tests from one app
- Setup guidance - Configure API access and platform prerequisites in the app
- Device and simulator connection - Connect Android targets and iOS simulators
- Natural-language test creation - Describe flows in plain English
- Test management - Create, edit, save, and rerun reusable scripts
- Live execution logs - Watch actions and progress as tests run
- Reports and history - Review past runs from a project results folder inside the desktop app
- JUnit XML output - Write standard test reports for CI systems and external tooling
- Headless support - Reuse scripts in CLI and automation workflows
- The desktop app connects to an Android device or emulator through ADB, or to an iOS simulator through Appium + XCUITest
- Captures full-screen device screenshots
- Scales down the screenshots for OpenAI model compatibility
- Sends screenshots and user instructions to OpenAI's computer-use model
- Receives structured actions such as click, scroll, type, keypress, wait, and drag
- Rescales model outputs back to real device coordinates
- Executes the actions on the device or simulator
- Validates assertions and handles failures
- Repeats until task completion
The desktop app is the primary way to use droid-cua.
For CI, scripting, or advanced workflows, droid-cua also includes a CLI for running saved instructions headlessly.
Desktop projects can also keep run reports in a results folder, including JUnit XML output that the app can read back as project history.
Install:
npm install -g @loadmill/droid-cuaExamples:
# Interactive CLI
droid-cua
# Headless Android run
droid-cua --avd adb:emulator-5554 --instructions tests/login.dcua
# Headless iOS simulator run
droid-cua --platform ios --avd "iPhone 16" --instructions tests/login.dcuaSupported CLI options include:
--avd--platform--instructions--record--debug
© 2025 Loadmill. All rights reserved.
