computer-use-mcp

💻 An model context protocol server for Claude to control your computer. This is very similar to computer use, but easy to set up and use locally.

To get best results:

• Install and enable the Rango browser extension. This enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates.
• On high resolution displays, consider zooming in to active windows. You can also bump up the font size setting in Rango to make the text more visible.

[!WARNING] At time of writing, models make frequent mistakes and are vulnerable to prompt injections. As this MCP server gives the model complete control of your computer, this could do a lot of damage. You should therefore treat this like giving a hyperactive toddler access to your computer - you probably want to supervise it closely, and consider only doing this in a sandboxed user account.

How it works

We implement a near identical computer use tool to Anthropic's official computer use guide, with some more nudging to prefer keyboard shortcuts.

This talks to your computer using nut.js.

Installation

Follow the instructions below for your preferred client:

• Claude Desktop
• Cursor
• Cline

Claude Desktop

(Recommended) Via manual .dxt installation

1. Find the latest dxt build in the GitHub Actions history (the top one)
2. In the 'Artifacts' section, download the computer-use-mcp-dxt file
3. Rename the .zip file to .dxt
4. Double-click the .dxt file to open with Claude Desktop
5. Click "Install"

(Advanced) Alternative: Via JSON configuration

1. Install Node.js
2. Open Claude Desktop and go to Settings → Developer
3. Click "Edit Config" to open your claude_desktop_config.json file
4. Add the following configuration to the "mcpServers" section:

{
  "mcpServers": {
    "computer-use": {
      "command": "npx",
      "args": [
        "-y",
        "computer-use-mcp"
      ]
    }
  }
}

5. Save the file and restart Claude Desktop

Cursor

(Recommended) Via one-click install

1. Click

(Advanced) Alternative: Via JSON configuration

Create either a global (~/.cursor/mcp.json) or project-specific (.cursor/mcp.json) configuration file:

{
  "mcpServers": {
    "computer-use": {
      "command": "npx",
      "args": ["-y", "computer-use-mcp"]
    }
  }
}

Cline

(Recommended) Via marketplace

1. Click the "MCP Servers" icon in the Cline extension
2. Search for "Computer Use" and click "Install"
3. Follow the prompts to install the server

(Advanced) Alternative: Via JSON configuration

1. Click the "MCP Servers" icon in the Cline extension
2. Click on the "Installed" tab, then the "Configure MCP Servers" button at the bottom
3. Add the following configuration to the "mcpServers" section:

{
  "mcpServers": {
    "computer-use": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "computer-use-mcp"]
    }
  }
}

Contributing

Pull requests are welcomed on GitHub! To get started:

1. Install Git and Node.js
2. Clone the repository
3. Install dependencies with npm install
4. Run npm run test to run tests
5. Build with npm run build

Releases

Versions follow the semantic versioning spec.

To release:

1. Use npm version <major | minor | patch> to bump the version
2. Run git push --follow-tags to push with tags
3. Wait for GitHub Actions to publish to the NPM registry.