unbrowse
v6.15.0
Published
Reverse-engineer any website into reusable API skills. Zero-dep single binary with embedded browser engine.
Readme
Unbrowse
⚠️ The Anthropic skill path retired in v6.15.0
Agents should connect via the MCP server. The CLI (
unbrowse ...) and SDK are unaffected. Add this to your MCP host config (Claude Desktop, Cursor, Codex, or any MCP-compatible client):{ "mcpServers": { "unbrowse": { "command": "npx", "args": ["-y", "unbrowse", "mcp"] } } }Then run
npx unbrowse setuponce. TheSKILL.mdfile from this package was retired in v6.15.0; the MCP block above replaces it.
This package installs the unbrowse CLI.
Unbrowse is a local Model Context Protocol (MCP) server and CLI that turns any website into a reusable API interface for agents. It captures network traffic, reverse-engineers the real endpoints underneath the UI, and stores what it learns in a shared marketplace so the next agent can reuse it instantly.
One agent learns a site once. Every later agent gets the fast path.
Unbrowse is a drop-in replacement for OpenClaw / agent-browser browser flows for agents: on the API-native path it is typically ~30x faster, ~90% cheaper, and turns repeated browser work into reusable route assets.
Security note: capture and execution stay local by default. Credentials stay on your machine. Learned API contracts are published to the shared marketplace only after capture.
MCP server
Unbrowse implements the Model Context Protocol over stdio. unbrowse mcp is the MCP server entrypoint.
- Protocol: JSON-RPC 2.0 MCP over stdio
- Handshake:
initialize,notifications/initialized,ping - Capability surface today:
tools/listandtools/call - Current MCP shape: tools only. No
resources/*orprompts/*methods yet. - Runtime model: the MCP server fronts the local Unbrowse runtime on
http://localhost:6969; hosts talk standard MCP, and Unbrowse uses the local HTTP runtime behind the scenes.
Core MCP tools:
- Discovery:
unbrowse_health,unbrowse_search,unbrowse_resolve,unbrowse_execute,unbrowse_feedback - Auth/cache:
unbrowse_login,unbrowse_skills,unbrowse_skill,unbrowse_sessions - Browser capture:
unbrowse_go,unbrowse_snap,unbrowse_click,unbrowse_fill,unbrowse_type,unbrowse_press,unbrowse_select,unbrowse_scroll,unbrowse_submit,unbrowse_screenshot,unbrowse_text,unbrowse_markdown,unbrowse_cookies,unbrowse_eval,unbrowse_sync,unbrowse_close
Typical MCP host config:
{
"mcpServers": {
"unbrowse": {
"command": "npx",
"args": ["-y", "unbrowse", "mcp"]
}
}
}Quick start
# One-line install from the latest GitHub release
curl -fsSL https://unbrowse.ai/install.sh | shThat installer now follows the Kuri pattern: detect platform, download the matching release tarball, install unbrowse into ~/.local/bin, then run unbrowse setup.
# Deterministic setup from a repo clone
git clone --single-branch --depth 1 https://github.com/unbrowse-ai/unbrowse.git ~/unbrowse
cd ~/unbrowse && ./setup --host off./setup installs repo dependencies, prebuilds the packaged CLI runtime, installs a stable unbrowse shim, and then runs the real first-time bootstrap: ToS acceptance, agent registration + API-key caching, and wallet detection when present.
If a wallet is configured, that wallet address becomes the contributor/payment truth: it is synced onto your agent profile, used as the destination for contributor payouts when your routes earn, and used as the spending wallet for paid marketplace routes.
Recommended for new installs: set up Crossmint lobster.cash during bootstrap. unbrowse setup now encourages it, and when the tooling is already present it will try npx @crossmint/lobster-cli setup automatically. That wallet becomes the payout destination for contributed routes and the spending wallet for paid marketplace routes.
Unbrowse supports wallet providers such as Crossmint lobster.cash for x402-gated routes. If you use lobster.cash, set LOBSTER_WALLET_ADDRESS. Other providers can use AGENT_WALLET_ADDRESS and optional AGENT_WALLET_PROVIDER.
For repeat npm use after a healthy publish:
npm install -g unbrowse
unbrowse setupThe npm package is binary-first: install downloads the prebuilt Bun-compiled CLI for your platform. It does not ship the TypeScript runtime or JS fallback launcher. On supported platforms, install now fails fast if the matching GitHub release asset is missing or unreachable.
For generic MCP hosts:
git clone --single-branch --depth 1 https://github.com/unbrowse-ai/unbrowse.git ~/unbrowse
cd ~/unbrowse && ./setup --host mcpThat writes a ready-to-import MCP config to ~/.config/unbrowse/mcp/unbrowse.json. A generic template is also published at /mcp.json.
If your agent host uses skills:
npx skills add unbrowse-ai/unbrowseUpgrading
Unbrowse no longer self-updates at runtime. If you already have Unbrowse installed, upgrade to the latest version after each release or the new flow may not work on your machine.
Check the exact command for your install with:
unbrowse upgradeCodex and Claude installs now also get a session-start update hint during unbrowse setup, so newer releases are surfaced in the host before the CLI drifts too far behind.
If you installed from a repo clone:
cd ~/unbrowse
git pull --ff-only
./setup --host offIf you installed for a generic MCP host:
cd ~/unbrowse
git pull --ff-only
./setup --host mcpIf your agent host uses skills, rerun its skill install/update command too:
npx skills add unbrowse-ai/unbrowseNeed help or want release updates? Join the Discord: discord.gg/VWugEeFNsG
Every CLI command auto-starts the local runtime on http://localhost:6969 by default, and unbrowse mcp uses that same runtime behind the MCP stdio surface. Override with UNBROWSE_URL, PORT, or HOST. On first startup it auto-registers as an agent with the marketplace and caches credentials in ~/.unbrowse/config.json. unbrowse setup now prompts for an email-shaped identity first; headless setups can provide UNBROWSE_AGENT_EMAIL.
Public companion docs: docs.unbrowse.ai
Works with Claude Code, Open Code, Cursor, Codex, Windsurf, and any agent host that can call a local CLI or skill.
What setup does
- Checks the local runtime/package-manager environment for the repo bootstrap or packaged CLI path.
- Prebuilds the packaged CLI runtime and installs the stable
unbrowseshim for the repo bootstrap path. - Verifies the bundled Kuri binary, or builds it from the vendored Kuri source when working from repo source with Zig installed.
- Registers the Open Code
/unbrowsecommand when Open Code is present. - Runs the first-use flow: ToS, agent registration/API-key caching, wallet detection, and Crossmint
lobster.cashencouragement. - Starts the local Unbrowse server unless
--no-startis passed.
Common commands
unbrowse health
unbrowse mcp
unbrowse resolve --intent "get trending searches" --url "https://google.com" --pretty
unbrowse login --url "https://calendar.google.com"
unbrowse skills
unbrowse search --intent "get stock prices"For most MCP hosts, the standard flow is unbrowse_resolve first, then unbrowse_execute. For JS-heavy or first-time capture workflows, use the browser tool chain: unbrowse_go -> unbrowse_snap -> action tools -> unbrowse_submit/unbrowse_sync -> unbrowse_close.
Dependency walk for multi-step UIs
Treat each successful browser submit as a dependency boundary.
- Do not jump straight to guessed downstream URLs like
/date-selection.htmlor/payment.htmlunless the current session already reached them through the real page flow. - Use
unbrowse_submitfor the actual transition, then trust the returnedurl,session_id, and any next-step hints over your own assumptions. unbrowse_syncafter a good transition so the route graph records which request chain unlocked the next page.- If a page later returns
abandonedCart,session_expired, or a wrong audience/product variant, restart from the last known good upstream step and walk forward again.
The dependency graph is not just API-to-API. On JS-heavy checkout flows it also captures browser-state prerequisites: selected product, resident/non-resident audience, date, slot, auth, and cart state. Future agents should reason from those prerequisites before calling deeper steps.
Demo notes
- First-time capture/indexing on a site can take 20-80 seconds. That is the slow path; repeats should be much faster.
- For website tasks, keep the agent on Unbrowse instead of letting it drift into generic web search or ad hoc
curl. - Reddit is still a harder target than most sites because of anti-bot protections. Prefer canonical
.jsonroutes when available.
Help shape the next eval
If you tried Unbrowse on a site or API and could not get it to work, add it to Discussion #53. We use that thread to collect missing or broken targets so we can turn them into requirements for the next eval pass.
Docs
The synced skill repo also carries the public docs set:
Whitepaper companion docs:
How it works
When an agent asks for something, Unbrowse first searches the marketplace for an existing skill. If one exists with enough confidence, it executes immediately. If not, Unbrowse captures the site, learns the APIs behind it, publishes a reusable skill, and executes that instead.
Every learned skill becomes discoverable by every future agent. Reliability scoring, feedback, schema drift, and verification keep the good paths hot and the broken ones out of the way.
Intent resolution pipeline
When you call POST /v1/intent/resolve, the orchestrator follows this priority chain:
- Route cache (5-min TTL) — instant hit if the same intent was recently resolved
- Marketplace search — semantic vector search ranked by composite score: 40% embedding similarity + 30% reliability + 15% freshness + 15% verification status
- Live capture — headless browser records network traffic, reverse-engineers API endpoints, publishes a new skill
- DOM fallback — if no API endpoints are found (static/SSR sites), structured data is extracted from rendered HTML
Skills published by live capture become available to all agents on the network.
The marketplace flywheel
Every new user makes the platform more valuable for the next one — like Waze, but for the web's APIs.
More Users → More Skills → More Domains → More Value
↑ |
└──────────────────────────────────────────┘Skills are stored in a shared marketplace at beta-api.unbrowse.ai. On first startup the server auto-registers as an agent and caches credentials in ~/.unbrowse/config.json. Skills published by any agent are discoverable via semantic search by all agents.
Skill lifecycle
- active — published, queryable, executable
- deprecated — low reliability (auto-triggered after consecutive failures)
- disabled — endpoint down (failed verification)
A background verification loop runs every 6 hours, executing safe (GET) endpoints to detect failures and schema drift. Skills with 3+ consecutive failures are automatically deprecated.
Authentication for gated sites
For most sites, auth is automatic. If you're logged into a site in Chrome or Firefox, Unbrowse reads your cookies directly from the browser's SQLite database — no extra steps needed. Cookies are resolved fresh on every call, so sessions stay current. For Chromium-family apps and Electron shells, /v1/auth/steal also accepts a custom cookie DB path or user-data dir plus an optional macOS Safe Storage service name.
| Strategy | How it works | When to use | | ------------------- | -------------------------------------------------- | ---------------------------------------------------- | | Auto cookie resolve | Reads cookie DBs from Chrome/Firefox automatically | Default — works if you're logged in via your browser | | Yolo mode | Opens Chrome with your real profile | Sites with complex auth (OAuth popups, 2FA) | | Interactive login | Opens a headed browser for manual login | Fallback when auto-resolve has no cookies |
Auth headers (CSRF tokens, API keys, authorization headers) are captured during browsing and stored in an encrypted vault (~/.unbrowse/vault/). Server-side fetches replay these headers automatically — no browser launch needed. Cross-domain auth (e.g. lu.ma cookies working on api2.luma.com) is handled transparently. Stale credentials (401/403 responses) are auto-deleted.
Mutation safety
Non-GET endpoints (POST, PUT, DELETE) require explicit confirmation:
dry_run: true— preview what would execute without side effectsconfirm_unsafe: true— explicit user consent to proceedconfirm_third_party_terms: true— extra explicit confirmation for policy-sensitive domains/actions such as X write endpoints
GET endpoints auto-execute. Mutations never fire without opt-in.
API reference
See the public API reference below for endpoints, search, feedback, auth, and issue reporting.
| Method | Endpoint | Description |
| ------ | ------------------------ | ---------------------------------------------- |
| POST | /v1/intent/resolve | Search marketplace, capture if needed, execute |
| POST | /v1/skills/:id/execute | Execute a specific skill |
| POST | /v1/auth/login | Interactive browser login |
| POST | /v1/auth/steal | Import cookies from browser/Electron storage |
| POST | /v1/search | Semantic search across all domains |
| POST | /v1/search/domain | Semantic search scoped to a domain |
| POST | /v1/feedback | Submit feedback (affects reliability scores) |
| POST | /v1/skills/:id/verify | Health check skill endpoints |
| POST | /v1/skills/:id/issues | Report a broken skill |
| GET | /v1/skills | List all marketplace skills |
| GET | /v1/stats/summary | Platform stats |
| GET | /health | Health check |
Docs
The standalone skill repo also carries the core repo docs:
Configuration
Runtime directories
~/.unbrowse/config.json # API key, agent ID, registration
~/.unbrowse/vault/credentials.enc # Encrypted credential store
~/.unbrowse/vault/.key # Encryption key (mode 0o600)
~/.unbrowse/skill-cache/ # Local skill manifest cache
~/.unbrowse/profiles/<domain>/ # Per-domain Chrome profiles
~/.unbrowse/logs/unbrowse-YYYY-MM-DD.log # Daily logsEnvironment variables
| Variable | Default | Description |
| -------------------------- | ----------------------- | ---------------------------- |
| PORT | 6969 | Server port |
| HOST | 127.0.0.1 | Server bind address |
| UNBROWSE_URL | http://localhost:6969 | Base URL for API calls |
| UNBROWSE_API_KEY | auto-generated | API key override |
| UNBROWSE_AGENT_EMAIL | — | Preferred email-style agent name for registration |
| UNBROWSE_TOS_ACCEPTED | — | Accept ToS non-interactively |
| UNBROWSE_NON_INTERACTIVE | — | Skip readline prompts |
System layout
src/
├── index.ts # Fastify server entrypoint (port 6969)
├── api/routes.ts # HTTP route definitions
├── orchestrator/ # Intent resolution pipeline
├── execution/ # Skill/endpoint execution + retry logic
├── capture/ # Headless browser traffic recording
├── reverse-engineer/ # HAR parsing → endpoint extraction
├── extraction/ # DOM structured data extraction
├── marketplace/ # Backend API client (beta-api.unbrowse.ai)
├── client/ # Agent registration & config management
├── auth/ # Interactive login + cookie extraction
├── vault/ # Encrypted credential storage (AES-256-CBC)
├── transform/ # Field projection + schema drift detection
├── verification/ # Periodic endpoint health checks
├── ratelimit/ # Request throttling
├── types/ # TypeScript type definitions
├── domain.ts # Domain utilities
└── logger.ts # LoggingStar History
License
AGPL-3.0 — see LICENSE.
