devicely
v2.2.12
Published
Devicely - One Command, All Devices. AI Powered Mobile Automation for iOS and Android
Maintainers
Readme
📱✨ Devicely
Orchestrate Your Mobile World. AI-Powered. Infinitely Scalable.
The ultimate command center for mobile automation and multi-device orchestration.
🚀 Quick Start • ✨ Key Features • 🌌 Infinite Possibilities • 📟 CLI Reference
⚡ Automate at Scale, Not Just Execute.
Devicely isn't just a tool; it's an orchestrator. It provides a unified, professional interface to control, automate, and inspect iOS and Android devices simultaneously using Natural Language AI, Voice Commands, and Live Commander Mode for real-time multi-device mirroring.
🌌 Glimpse of the Infinite
Devicely redefines what's possible with your mobile infrastructure. By bridging the gap between human intent and device execution, you can:
- 🧪 Massive Parallel Testing: Transform a 2-hour manual smoke test into a 5-minute automated broadcast across your entire device fleet.
- 🤖 AI-Native QA: Move beyond brittle selectors. Use natural language to navigate apps, verify UI, and find bugs across different screen sizes autonomously.
- 🏢 Enterprise Device Labs: Turn any desk or rack of physical devices into a private, web-accessible cloud lab for your entire global team.
- 🔄 Instant Bug Reproduction: Record a complex bug on one device and instantly "broadcast" those exact steps to every other device to see which OS versions are affected.
- 🎤 Voice-Driven Automation: Speak commands naturally and watch your entire device fleet respond in real-time.
- 🔀 Cross-Platform Sync: Run the same command on iOS and Android simultaneously with platform-specific intelligence.
✨ The Devicely Advantage
🤖 AI-Native Interaction
Stop hunting for element IDs. Devicely understands your intent.
- Natural Language Commands:
"Open Instagram and find the search button"or"Take a screenshot on all Android devices". - Voice Control: Speak commands naturally with automatic silence detection and multi-phrase support.
- Context Awareness: Automatically identifies buttons, inputs, and text across iOS and Android.
- 7 AI Providers: Choose from OpenAI 🤖, Google Gemini ✨, Anthropic Claude 🧠, GitHub Copilot 🐙, Groq ⚡, Cohere 🌊, or Mistral AI 🌬️.
- Model Selection: Pick specific models (GPT-4 Turbo, Claude 3.5 Sonnet, Gemini 2.0 Flash, Llama 3 70B, etc.).
- Smart Error Handling: Clear, actionable error messages displayed inline with results.
⚡ Quick Actions Panel
Three rapid-fire shortcuts for common automation tasks:
- Type Text to Send: Quickly send text input to devices without typing commands.
- Element to Tap: Click elements by name or coordinates (x,y) instantly.
- App ID to Launch: Launch apps by package/bundle ID with autocomplete dropdown.
- History Navigation: Use arrow keys to cycle through previous inputs.
🎮 Unified Command Center
A single conductor for your entire device orchestra.
- Cross-Platform: Native, low-latency support for iOS 14+ and Android 5+.
- Parallel Execution: Run the same action on 5, 50, or 100+ devices simultaneously with zero overhead.
- Synchronized Commands: Execute platform-specific commands (different apps) on mixed device fleets at the exact same time.
- Live Feedback: See real-time logs, status updates, and visual confirmations via high-speed WebSockets.
- API Key Management: Secure credential storage with show/hide toggles for easy verification.
🔍 Smart UI Inspector
The most practical way to explore your apps.
- Visual Element Scan: Instantly see all clickable, enabled, and visible elements.
- Point-and-Click Control: Interact with devices directly through the inspector interface.
- Developer Friendly: Export clean selectors and coordinates for your automation scripts.
🔴 Record & Broadcast
- Zero-Code Automation: Record complex manual workflows (logins, checkouts, onboarding) and save them as reusable scripts.
- AI-Generated Recordings: Voice or text commands automatically converted to replayable scripts.
- Fleet Replay: Replay recorded flows on any single device or your entire laboratory at once.
- Edit & Refine: Full editor for AI-generated and manual recordings with add, remove, and modify capabilities.
👑 Commander Mode
- Live Device Mirroring: See real-time screen updates from commander device with follower devices displayed simultaneously.
- Touch Broadcasting: Tap on commander screen and watch all follower devices mirror the exact action.
- Quick Commander Swap: Dropdown at top-left of mirror screen to instantly change which device leads the session.
- Auto-Setup: First device automatically becomes commander, rest become followers.
- Visual Feedback: Clear badges showing commander (👑) and follower devices (📱).
🎤 Voice Commands
- Hands-Free Operation: Control your devices without touching a keyboard.
- Continuous Listening: Speak naturally with pauses - 2-second silence detection auto-stops.
- Live Transcription: See your words convert to commands in real-time.
- Complex Multi-Step: Voice commands like "launch settings scroll up launch camera go to google.com press home" work seamlessly.
🚀 Quick Start
Get up and running in less than 60 seconds.
1. Installation
# Install Devicely globally via NPM
npm install -g devicely2. Launch
# Start the command center
devicely startVisit http://localhost:3001 to enter your Command Center.
3. Configure AI (Optional)
To enable natural language and voice commands:
- Visit Settings ⚙️ → AI Configuration
- Choose from 7 AI providers with model selection
- Add your API key (secured locally, never transmitted)
- Start using AI:
"launch settings on all devices"
Free AI Options: Gemini, Groq, and Cohere offer generous free tiers!
🎯 Usage Examples
Natural Language Commands
# Simple actions
"take screenshot"
"launch chrome"
"go to google.com"
# Multi-step sequences
"launch settings scroll up launch camera go to youtube.com press home"
# Cross-platform (automatically uses correct package IDs)
"launch settings" # → com.apple.Preferences (iOS) + com.android.settings (Android)Voice Commands
- Click 🎤 microphone button
- Speak: "launch settings scroll up launch camera"
- Pause for 2 seconds
- Command executes on all selected devices!
Recording & Replay
- Click Record button
- Perform actions on device
- Click Stop Recording
- Save with name
- Replay anytime on any device(s)
Commander Mode
- Connect 2+ devices
- First device auto-becomes commander
- Click on commander screen to broadcast actions
- Use top-left dropdown on mirror to swap commander
- All devices stay synchronized automatically
🤖 AI Provider Comparison
Devicely supports 7 leading AI providers with multiple models to choose from:
| Provider | Models | Speed | Free Tier | Best For | |----------|--------|-------|-----------|----------| | 🤖 OpenAI | GPT-4 Turbo, GPT-4, GPT-3.5 | 🔥🔥 | ❌ | General purpose, accuracy | | ✨ Google Gemini | 2.0 Flash, 1.5 Pro, 1.5 Flash | 🔥🔥🔥 | ✅ Yes | Cost-effective, multimodal | | 🧠 Anthropic Claude | 3.5 Sonnet, 3 Opus, 3 Haiku | 🔥🔥 | ❌ | Complex reasoning, long context | | 🐙 GitHub Copilot | GPT-4, GPT-3.5 | 🔥🔥 | ❌ | Developers with subscription | | ⚡ Groq | Llama 3 70B, Mixtral, Gemma | 🔥🔥🔥 | ✅ Yes | Ultra-fast inference | | 🌊 Cohere | Command R+, Command R | 🔥🔥 | ✅ Yes | Enterprise-grade | | 🌬️ Mistral AI | Large, Medium, Small | 🔥🔥 | ❌ | EU compliance, open-source |
💡 Recommendations
- Free Users: Start with Gemini 2.0 Flash or Groq Llama 3
- Speed Critical: Use Groq (fastest inference available)
- Best Quality: Claude 3.5 Sonnet or GPT-4 Turbo
- Cost Effective: Gemini Flash or GPT-3.5 Turbo
Get API Keys:
- OpenAI: https://platform.openai.com/api-keys
- Gemini: https://makersuite.google.com/app/apikey
- Claude: https://console.anthropic.com/account/keys
- Groq: https://console.groq.com/keys
- Cohere: https://dashboard.cohere.com/api-keys
- Mistral: https://console.mistral.ai/api-keys
📟 CLI Reference
Devicely comes with a powerful command-line interface for quick actions:
| Command | Description |
| :--- | :--- |
| devicely start | Launch the web-based Command Center. |
| devicely list | List all connected iOS and Android devices. |
| devicely doctor | Verify system requirements (ADB, WDA, etc.). |
| devicely exec "<cmd>" | Execute a natural language command on all devices. |
🆕 Latest Features (v2.2.11 - February 2026)
🐛 Commander Mode Error Fix (v2.2.11)
- Fixed: "Error starting commander mode" when devices are already connected
- Improved: Commander mode now gracefully handles already-active sessions
- Enhanced: Better error messaging and automatic session management
- Smart: Auto-switches commander between devices without throwing errors
👑 Commander Mode with Quick Swap (NEW!)
- Real-Time Mirroring: Live screen mirroring of commander device with follower devices displayed in background
- Commander Dropdown: Top-left dropdown on mirror screen for quick commander device changes
- One-Click Swap: Select any connected device to instantly make it the new commander
- Visual Indicators: Commander badge (👑) on device cards and mirror screen
- Auto-Synchronization: WebSocket-based real-time updates across all components
- Touch Broadcasting: Tap commander screen, all followers execute the same action
- Seamless Transitions: Smooth commander swaps with automatic follower re-assignment
- Button Updates: "Connect All" and "Select All" for clearer bulk operations
🤖 Multi-AI Provider Support
- 7 AI Providers: OpenAI, Gemini, Claude, Copilot, Groq, Cohere, Mistral AI
- Model Selection: Choose specific models for each provider (GPT-4 Turbo, Claude 3.5 Sonnet, Llama 3 70B, etc.)
- Smart Defaults: Auto-selects best model if not specified (marked with ⭐)
- Revamped UI: Modern Settings interface with provider cards, model dropdowns, and help sections
- Free Tiers: Gemini, Groq, and Cohere offer generous free tiers for testing
- Performance Hints: UI shows speed/cost comparisons (Groq = fastest, Claude = best reasoning)
✨ Enhanced AI Capabilities
- Multi-Platform Intelligence: Single AI command generates platform-specific actions for iOS and Android
- Simultaneous Execution: All devices execute at the same time, not sequentially
- Error Visibility: AI errors (quota limits, auth failures) shown inline with results
- Response Cleaning: Automatically removes markdown and explanations from AI output
- Cross-Platform Apps: AI generates both iOS and Android app bundles (Settings, Camera, Chrome, etc.)
🎤 Improved Voice Input
- Extended Listening: 2-second silence detection for natural speech
- Continuous Speech: Speak multiple phrases with natural pauses
- Live Transcription: See your words accumulate in real-time
- Complex Commands: "launch settings scroll up launch camera go to google.com press home" works flawlessly
- No Duplicates: Fixed transcript accumulation for clean output
🔐 Settings Enhancements
- Revamped AI Config Tab: Professional card-based design with dark mode support
- Dynamic API Key Input: Field changes based on selected provider
- Show/Hide Toggles: Individual toggles for all 7 provider keys
- Status Display: Green success box showing current provider, model, and key preview
- Quick Tips Section: In-UI recommendations for choosing providers
- Close Button: Easy navigation back to main screen
- Dark Mode: Proper color schemes for light and dark themes
📝 Recording Improvements
- AI Recording Editor: Edit AI-generated recordings like manual ones
- Format Conversion: Seamlessly handles both string and array command formats
- Save & Replay: Edit, save, and replay AI-generated commands
- Status Persistence: Recording status preserved when navigating between screens
📜 License & Privacy
Proprietary & Confidential. Devicely is currently in a controlled rollout phase. This NPM package provides the binary execution environment. Source code remains private under phase 2 & 3 of our roadmap.
Privacy First:
- All API keys stored locally on your machine
- No telemetry or data collection
- Commands executed directly on your devices
- No cloud dependencies for core functionality
For enterprise inquiries or commercial access, contact: [email protected]
Ready to Scale Your Mobile Automation?
Install on NPM • Visit Homepage
Built with ❤️ for the next generation of Mobile Engineers.
