Screen, keyboard and pointer control for Namzu agents.

Install · Usage · Documentation

Screen capture, keyboard and pointer control, behind one adapter interface. Which backend serves a call depends on the platform, and what a platform cannot do is reported as a capability rather than discovered as a failure.

Install

pnpm add @namzu/sdk @namzu/computer-use

@namzu/sdk is a peer dependency. Install both.

Usage

import {
  SubprocessComputerUseHost,
  type SubprocessComputerUseHostOptions,
} from '@namzu/computer-use'
import { createComputerUseTool, ToolRegistry } from '@namzu/sdk'

const options: SubprocessComputerUseHostOptions = {
  env: process.env,
  platform: process.platform,
}
const host = new SubprocessComputerUseHost(options)
await host.initialize()

console.log(host.capabilities)
// {
//   displayServer: 'darwin',
//   screenshot: true,
//   mouse: true,
//   keyboard: true,
//   cursorPosition: false,  // unless `cliclick` is installed
//   clipboard: true,
// }

const registry = new ToolRegistry()
registry.register(createComputerUseTool(host))

Documentation

• Computer use — the platform matrix, capability flags and error surface
• Namzu docs

License

FSL-1.1-MIT, converting to MIT two years after each release.