@intuned/computer-use

Intuned SDK computer-use agent (BETA): drive a Playwright page with any vision-capable model — screenshots in, click/type/scroll actions out, executed on the exact page you pass in. Built on the AI SDK, routed through the Intuned AI gateway (or a direct provider API key).

import { executeTask } from "@intuned/computer-use";

const result = await executeTask({
  page,
  task: "Scroll down until the year 2021 is visible and report the first 2021 entry's title.",
  maxTurns: 20,
  timeoutInMs: 120_000,
});
console.log(result.finalText, result.totalCostInCents);

Highlights

• Reliable interactions: every action syncs the viewport to the real window size first, waits for the network it triggers to settle, and scrolls slowly in steps so lazy-loaded content renders instead of being skipped.
• Browser-event awareness: file downloads, popup tabs opening, and tabs closing during an action are detected and reported back to the model, alongside the current URL.
• Structured results: pass an outputSchema (JSON schema) and get a schema-validated output object back.
• Extensible: add your own function tools via tools; opt into the execute_javascript escape hatch with enableJavaScriptTool.

Development

yarn install
yarn build   # tsc + babel into dist/
yarn test    # vitest
yarn lint