https://github.com/user-attachments/assets/15b89e22-b981-4a2f-ac7d-644ee60746cc

Installation

npm i -g mousecrack

Usage

[!WARNING]
This project is still experimental! For educational purposes only.

Available as an SDK (for developers) and CLI (for agents).

SDK

import { move, steps } from 'mousecrack';

await move(200, 400);

// or alternatively...
const from = { x: 100, y: 200 }
const to = { x: 200, y: 400 }
await steps(from, to);

// [
//   { x: 100, y: 200, t: 0 },
//   { x: 95, y: 202, t: 10.528131778472712 },
//   { x: 90, y: 210, t: 21.040190062833986 },
//   { x: 81, y: 223, t: 31.892832399406224 },
//   ...

CLI

mousecrack move 200 400 # (x, y)
mousecrack steps 100 200 200 400 # from (x, y), to (x, y)

For Claude Code:

/plugin marketplace add puffinsoft/mousecrack
/plugin install move-mouse@mousecrack

For Codex:

codex plugin marketplace add puffinsoft/mousecrack
codex plugin add move-mouse@mousecrack

📌 Choosing Models

To support all hardware systems, we develop two models- Standard (2x128 LSTM) and Lite (2x64 LSTM).

Append lite or standard as a parameter to each CLI command to choose:

mousecrack move 200 400 lite # or standard
mousecrack steps 100 200 200 400 lite # or standard

And with the SDK:

import { ModelType, move, steps } from 'mousecrack';

await move(200, 400, ModelType.LITE);
await steps(from, to, ModelType.LITE);

[!CAUTION] Lite is not recommended, unless your hardware forces you to.

It performs inference, on average, 29% faster, but the end-to-end generation time can take up to 8x as long.

This is because the smaller model tends to veer off course more often.

How does it work?

Mousecrack treats mouse prediction like a time forecasting problem.

It models mouse movement as a change in position (dx, dy) and time (dt), and tries to predict the next step in this multivariate time series.

To avoid the mode collapse problem, Mousecrack uses a Mixture Density Network to model several trajectories as a probability distribution.

Mousecrack is open source software, licensed under the MIT license.