@forestadmin/workflow-executor
v1.30.0
Published
Run Forest Admin workflow steps on your own infrastructure.
Readme
@forestadmin/workflow-executor
Run Forest Admin workflow steps on your own infrastructure.
The executor polls the Forest orchestrator for pending steps, runs them locally (with access to your data via the Forest agent), and reports results back. No client data ever leaves your infrastructure.
Prerequisites
Make sure you are on the latest version of your Forest Admin agent (Node.js/JS or Ruby), then point your agent at the executor with workflowExecutorUrl:
createAgent({
// ...
workflowExecutorUrl: process.env.WORKFLOW_EXECUTOR_URL, // e.g. http://localhost:3400
})This is required for the executor to work: when workflowExecutorUrl is set, the agent mounts the route that forwards workflow requests to the executor (and relays the JWT for auth). If it is left unset, the agent returns 404 on those routes and the executor never receives any work.
Drive it from an environment variable (WORKFLOW_EXECUTOR_URL above) so each deployment can target its own executor. The URL is where the agent reaches the executor — its HTTP server (default port 3400). When the agent and executor run on separate hosts behind a private network (e.g. an internal load balancer), use the executor's internal address, and make sure the agent can reach the executor's HTTP port.
Docker (recommended)
The image is published as ghcr.io/forestadmin/runtime. It was previously named
ghcr.io/forestadmin/workflow-executor, which is still published from the exact
same builds — existing deployments keep working, but new ones should use
runtime.
Quick start
cp .env.example .env # fill in your secrets
docker compose upThe docker-compose.yml at the root of this package starts a single executor instance. See .env.example for the full list of environment variables and their descriptions.
Run directly
docker run -d \
-e FOREST_ENV_SECRET="your-env-secret" \
-e FOREST_AUTH_SECRET="your-auth-secret" \
-e AGENT_URL="http://host.docker.internal:3351" \
-e DATABASE_URL="postgres://user:[email protected]:5432/mydb" \
-p 3400:3400 \
ghcr.io/forestadmin/runtime:latestNote: When the executor runs in Docker and your agent runs on the host machine, use
host.docker.internalinstead oflocalhostinAGENT_URLandDATABASE_URL.
Observability (OpenTelemetry)
The Docker image ships with OpenTelemetry APM built in, and works with any OTLP-compatible backend (Datadog, Grafana Tempo, Jaeger, Honeycomb, etc.). It is off by default and turns on automatically as soon as you point it at an OTLP receiver — no code changes or extra installs required. Tracing is set up before the app starts (auto-instrumentation for HTTP, Postgres, etc.) and buffered spans are flushed on graceful shutdown.
Configure it entirely through the standard OTel environment variables:
| Variable | Description |
| --- | --- |
| OTEL_EXPORTER_OTLP_ENDPOINT | OTLP receiver URL (e.g. http://collector:4318). Tracing stays disabled until this is set. |
| OTEL_SERVICE_NAME | Service name reported in traces. Default: forestadmin-workflow-executor. |
| OTEL_RESOURCE_ATTRIBUTES | Extra resource attributes, e.g. deployment.environment=production,version=1.7.0. |
| OTEL_SDK_DISABLED | Set to true to force-disable tracing even when an endpoint is configured. |
docker run -d \
-e FOREST_ENV_SECRET="your-env-secret" \
-e FOREST_AUTH_SECRET="your-auth-secret" \
-e AGENT_URL="http://host.docker.internal:3351" \
-e DATABASE_URL="postgres://user:[email protected]:5432/mydb" \
-e OTEL_EXPORTER_OTLP_ENDPOINT="http://collector:4318" \
-p 3400:3400 \
ghcr.io/forestadmin/runtime:latestNote: OpenTelemetry is bundled only in the Docker image. It is not shipped with the npm package (
npx @forestadmin/workflow-executor).
Without Docker
With a database
Requires Node.js ≥ 22.12.0 and a Postgres database:
FOREST_ENV_SECRET="your-env-secret" \
FOREST_AUTH_SECRET="your-auth-secret" \
AGENT_URL="https://your-agent-url" \
DATABASE_URL="postgres://user:pass@localhost:5432/mydb" \
npx @forestadmin/workflow-executorWhere to find your credentials:
Both values are already in your agent's environment variables. FOREST_ENV_SECRET can also be found in app.forestadmin.com → Settings → Environments → click your environment. FOREST_AUTH_SECRET is defined on your side only and is not available in the Forest Admin UI.
AGENT_URL is the URL where your Forest Admin agent is running (e.g. http://localhost:3351).
Database connection
The Postgres connection can be provided in two ways. If DATABASE_URL is set, it
is used as-is. Otherwise the executor builds the connection string from individual
parts — handy when your platform exposes credentials as separate variables:
| Variable | Required | Description |
| --- | --- | --- |
| DATABASE_HOST | yes | Database host |
| DATABASE_NAME | yes | Database name |
| DATABASE_USER | yes | Database user |
| DATABASE_PASSWORD | no | Database password |
| DATABASE_PORT | no | Database port (default: 5432) |
| DATABASE_SCHEMA | no | Postgres schema for the executor's tables (default: forest) |
FOREST_ENV_SECRET="your-env-secret" \
FOREST_AUTH_SECRET="your-auth-secret" \
AGENT_URL="https://your-agent-url" \
DATABASE_HOST="localhost" \
DATABASE_NAME="mydb" \
DATABASE_USER="user" \
DATABASE_PASSWORD="pass" \
DATABASE_SSL="false" \
npx @forestadmin/workflow-executorDATABASE_SSL defaults to true (managed Postgres requires TLS); set it to false for a local database without TLS.
DATABASE_URL takes precedence: when it is set, the individual parts are ignored.
DATABASE_SCHEMA sets the Postgres schema the executor's tables live under (default: forest). Set it to point the executor at another schema — e.g. public when it owns the database, or a shared schema alongside your agent. The value must be a valid Postgres identifier.
On boot the executor creates the schema if it is missing, which requires the CREATE privilege on the database:
GRANT CREATE ON DATABASE "<db>" TO "<user>";If you can't grant database-level CREATE, pre-create the schema with an admin role and grant only schema-level rights — the executor probes for the schema first and skips creation when it already exists, so no database-level CREATE is needed:
CREATE SCHEMA analytics;
GRANT USAGE, CREATE ON SCHEMA analytics TO "<user>";(Note: Postgres checks the database-level CREATE privilege for CREATE SCHEMA IF NOT EXISTS even when the schema exists, so the executor gates the statement on an existence probe rather than relying on IF NOT EXISTS.)
Using DATABASE_SCHEMA=public on a dedicated database is the simplest setup — public always exists, so no CREATE on the database is needed. On Postgres 15+, though, public no longer grants CREATE to non-owner roles by default, so the executor still needs it to create its tables there:
GRANT USAGE, CREATE ON SCHEMA public TO "<user>";OAuth-protected MCP connectors
When your workflows use OAuth-protected MCP connectors, the executor stores each user's OAuth credentials in its database, encrypted at rest. Provide the encryption key the same way as the other secrets (in .env, or with -e on docker run):
| Variable | Description |
| --- | --- |
| FOREST_EXECUTOR_ENCRYPTION_KEY | At-rest encryption key (AES-256-GCM) for the OAuth credentials the executor stores. Generate with openssl rand -hex 32. Use a separate secret from FOREST_AUTH_SECRET. The value isn't validated, so use a genuinely random secret. |
- Required only for OAuth-protected MCP connectors, and read lazily — an executor that stores no such credentials boots and runs fine without it.
- Use the same value on every instance that shares a database. Otherwise an instance cannot decrypt credentials stored by another.
- Treat it as permanent: there is no managed rotation. Changing it forces every affected user to reconnect their OAuth-protected MCP connectors.
When an MCP step fails to load its tools
The executor names the reason at Error, so it is in your logs at the default level:
{
"level": "Error",
"message": "MCP servers failed to load tools",
"requestedMcpServerId": "39",
"mcpServerName": "acme-crm",
"failures": [
{ "server": "acme-crm", "kind": "connection", "error": "connect ECONNREFUSED 10.0.4.12:8080" }
]
}kind tells you where to look:
auth— the server rejected the credential (HTTP 401). On an OAuth2 connector the executor refreshes the token and retries once on its own, so this line concerns static credentials; an OAuth2 connector that recovered logsMCP tools loaded after refreshing the credentialatInfo, and one that cannot pauses the run for re-authentication instead.connection— unreachable, refused, or slower than the 15s per-server load timeout.unknown— the server answered but the load failed anyway, including HTTP 403 (the credential is valid but lacks the permission, which no refresh can fix) and an integration this build does not support; theerrortext carries the reason.
A server that answers but exposes no tools is not a failure: you get an empty tool list and no error.
Set LOG_LEVEL=Debug to add one line per server with its tool count and load time, which is how you find the connector that is slowing a step down.
Testing only
The following modes skip the database requirement but are not suitable for production — state is lost on restart.
Docker
docker run --rm \
-e FOREST_ENV_SECRET="your-env-secret" \
-e FOREST_AUTH_SECRET="your-auth-secret" \
-e AGENT_URL="http://host.docker.internal:3351" \
-p 3400:3400 \
ghcr.io/forestadmin/runtime:latest \
node packages/workflow-executor/dist/cli.js --in-memory --jsonWithout Docker
FOREST_ENV_SECRET="your-env-secret" \
FOREST_AUTH_SECRET="your-auth-secret" \
AGENT_URL="https://your-agent-url" \
npx @forestadmin/workflow-executor --in-memoryOAuth2-protected MCP
To exercise the executor's OAuth2-protected MCP path end-to-end, point it at mcp-oauth-test-server — a standalone OAuth2 + MCP server that can simulate refresh-token revocation/rotation, consent denial, and upstream 403s.
