@reportforge/playwright-pdf
v0.22.1
Published
Playwright Test reporter that generates designed PDF reports: minimal, detailed, and executive templates with CI/CD integrations
Maintainers
Readme
@reportforge/playwright-pdf
Playwright PDF reporter: generate branded PDF reports from Playwright Test results. Three templates (minimal, detailed, executive) for developers, QA teams, and stakeholders. CI-ready, self-contained, with embedded screenshots and charts.
Drop it into any Playwright project and get a PDF report on every CI run. No changes to your tests.
Report Gallery
Three templates, one reporter. Every PDF is fully offline: fonts, charts, and screenshots are embedded.
Features
- 3 templates:
minimal(developer),detailed(QA team),executive(stakeholders) - Detailed reports: KPI dashboard, suite breakdown with inline failure detail (error, screenshot, root-cause chip) under each failed test, CI/CD environment
- Embedded Chart.js: pass-rate doughnut + per-suite bar chart, bundled inline (no CDN); every suite gets its own bar, and large runs switch to full-width suite charts that continue across pages, so per-suite coverage and failures stay visible run-wide
- Self-contained PDFs: screenshots, fonts, logos all embedded; share or archive with confidence
- Custom branding: logo, primary/accent colours, watermark, PDF password encryption
- Dynamic filenames:
{date},{branch},{status}tokens in the output path - Instant demo report:
npx @reportforge/playwright-pdf demogenerates a realistic sample PDF before subscribing, no license key required - CI/CD snippets: GitHub Actions, GitLab CI, Bitbucket Pipelines, Jenkins, Azure DevOps
- Live runs: opt-in
livestreams per-test progress to an unguessable watch link printed at run start; all shards of one CI run converge on a single live dashboard while tests execute. The PDF is still produced at the end, unchanged - Shard merging: combine N Playwright JSON shard reports into one PDF via
shardResults; accepts glob patterns or explicit paths - Notifications: post pass/fail summaries to Slack, Teams, Discord, or email after each run; configurable trigger (
always/failure/success) per channel; email and Discord support optional PDF attachment viaattachPdf - Flakiness trend: top-N flakiest tests table with per-test dot sparkline across stored history runs in the
detailedtemplate;flakinessTopNoption (default 5,0disables) - Pass-rate trend: cross-run trend chart from stored history; opt-in
remoteHistorykeeps the trend alive on ephemeral CI runners by storing aggregate numbers only (pass rate, counts, duration, verdict; no test titles or error text, and the branch name never travels in plaintext), with no extra network calls - Offline failure analysis: sorts each failure into one of 7 root-cause buckets and renders a root-cause chip under each failed test in the
detailedPDF (dominant-cause one-liner inexecutive). No network, no AI service: a small embedded classifier with automatic updates; pin it any time. Full details at reportforge.org/docs/advanced/failure-analysis. - On-device training: teach the classifier your team's failures without any data leaving your machine. Label locally-collected samples (
npx @reportforge/playwright-pdf label-feedback), thentrain-modeltrains and cross-validates a personal layer on-device; it activates only when it measurably beats the base model on your own labeled set (evaluate-modelshows the comparison any time). Commit the model file to your repo viafailureAnalysis.localModelPathto share it with CI. Training data, the trained model, and evaluation are all local files; the analysis code cannot even name a network primitive (enforced by an automated source audit). npx @reportforge/playwright-pdf export-feedback: merges your locally-collected feedback (tokenized + redacted) into one CSV for review or moving between machines. Local file only; there is no upload.- Rich execution capture: opt-in "Steps to Reproduce" outline (a nested, copy-pasteable Markdown list of your
test.steps and assertions; addapiStepsfor the full click/fill/check trail), Node console tail, and trace/video links under each failed test in the defect log. Read straight from the Playwright step tree: no fixtures, no test-code changes. Enable viacapture(steps/apiSteps/console/evidence); off by default. - Configurable sections: add or remove any report section per template via
sections. - Executive report brief band: leads with a plain-language brief (trend + root causes) and one hero pass-rate number instead of a flat KPI grid
- Hybrid licensing: one short key unlocks it; reports keep rendering offline via a locally cached license between refreshes
- Update notice: when a newer reporter version is published, each run ends with one info line naming it and the update command; no extra network calls
Quick Start
npm install --save-dev @reportforge/playwright-pdf puppeteer-core// playwright.config.ts
import { defineConfig } from '@playwright/test';
import { defineReporterConfig } from '@reportforge/playwright-pdf';
export default defineConfig({
reporter: [
['@reportforge/playwright-pdf', defineReporterConfig({
template: 'detailed',
outputFile: 'reports/{date}-{branch}-{status}.pdf',
})],
],
use: { screenshot: 'only-on-failure' },
});defineReporterConfig is an optional typed identity helper: it gives you IntelliSense and type-checking on the options object without a separate ReporterOptions import. You can also pass a plain object literal if you prefer.
npx playwright test
# → reports/2026-05-01-main-failed.pdfSee it first. Run
npx @reportforge/playwright-pdf demoto generate a realistic sample PDF in under 60 seconds, no license key required. Supports--template=minimal|detailed|executiveand--output=<path>.
License required. Start a 7-day free trial at reportforge.org/pricing: card required, no charge until day 8. Paste the resulting
RFSU-…key intoRF_LICENSE_KEY. Without a valid license the reporter logs a warning and skips PDF generation; your Playwright tests still run normally. When a newer reporter version exists, runs end with a one-line update notice.
Installation
Requirements
- Node.js ≥ 20
@playwright/test≥ 1.40 (peer dependency)puppeteer-core≥ 21 < 26 (peer dependency)- Chrome or Chromium installed on the machine
Chrome setup
The reporter locates Chrome via the puppeteerExecutablePath option first, then the PUPPETEER_EXECUTABLE_PATH environment variable, then chrome-finder (system Chrome), then puppeteer-core's bundled Chromium if present. Full per-OS instructions: reportforge.org/docs/running-tests#chrome-setup.
Windows
winget install Google.Chrome
$env:PUPPETEER_EXECUTABLE_PATH = "C:\Program Files\Google\Chrome\Application\chrome.exe"Linux (Debian / Ubuntu)
wget -q -O - https://dl.google.com/linux/linux_signing_key.pub | \
sudo gpg --dearmor -o /usr/share/keyrings/google-chrome.gpg
echo "deb [arch=amd64 signed-by=/usr/share/keyrings/google-chrome.gpg] \
http://dl.google.com/linux/chrome/deb/ stable main" | \
sudo tee /etc/apt/sources.list.d/google-chrome.list
sudo apt-get update -qq && sudo apt-get install -y google-chrome-stable
export PUPPETEER_EXECUTABLE_PATH=/usr/bin/google-chrome-stableNote: Do not use the
chromium-browserapt package: it installs as a snap on Ubuntu and Puppeteer cannot drive it.
macOS
brew install --cask google-chrome
export PUPPETEER_EXECUTABLE_PATH="/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"Or set the path in playwright.config.ts:
reporter: [['@reportforge/playwright-pdf', {
puppeteerExecutablePath: '/usr/bin/google-chrome-stable',
}]]Pricing
| Plan | INR | USD | Includes | |---|---|---|---| | Monthly | ₹999 / month | $12 / month | All three templates · custom branding · PDF encryption · up to 25 active machines · priority email support | | Yearly | ₹8,499 / year | $99 / year | Everything in Monthly · ~29-31% saving vs monthly |
Currency is auto-detected by region; toggle on the pricing page.
Configuration
All options are the second element of the reporter tuple.
| Option | Type | Default | Description |
|---|---|---|---|
| outputFile | string | 'playwright-report/{date}-report.pdf' | Output path. Supports tokens: {date}, {datetime}, {branch}, {status}, {total}, {passed}, {failed}, {project}. Directory is created if absent. |
| template | 'minimal' \| 'detailed' \| 'executive' or array | 'minimal' | Template(s) to generate. Pass an array to produce one PDF per template in one run: the template name is appended to each output filename automatically (e.g. report-detailed.pdf). |
| licenseKey | string | env RF_LICENSE_KEY | Subscription key (format RFSU-…). Falls back to the RF_LICENSE_KEY environment variable. PDF generation is skipped when absent or invalid. |
| logo | string | n/a | Path to a logo image (PNG, JPG, or SVG) to embed in the report header. Supports absolute and relative paths. |
| primaryColor | string | '#CC785C' | Primary brand colour (3-, 6-, or 8-digit hex). Used for headers and accent bars. |
| accentColor | string | '#3F7D58' | Accent brand colour (hex). Used for highlights and badges. |
| watermark | string | n/a | Text to render as a diagonal watermark overlay from the Suite Breakdown page onward (summary/chart pages stay clean), e.g. 'CONFIDENTIAL' or 'DRAFT'. |
| pdfPassword | string | n/a | Password-protect the generated PDF. Requires qpdf installed on the system. |
| reportTitle | string | 'Playwright Test Report' | Custom title for the report cover page and running header. |
| projectName | string | from package.json | Project or application name. Inferred from the package.json name field if absent. |
| open | boolean | false | Open the generated PDF automatically after generation. For local use only; ignored in CI. |
| logLevel | 'silent' \| 'error' \| 'warn' \| 'info' \| 'debug' | 'info' | Console verbosity for [reportforge] log lines. 'silent' suppresses everything including errors; 'debug' adds diagnostics. The RF_DEBUG=1 env var always forces debug, overriding this option. |
| puppeteerExecutablePath | string | auto-detect | Full path to a Chrome or Chromium binary. Falls back to PUPPETEER_EXECUTABLE_PATH env, then system Chrome discovery. |
| serverUrl | string | 'https://reportforge.org' | Base URL for the ReportForge licensing server. Override only for self-hosting or local development. |
| compressionLevel | 'auto' \| 'none' \| 'balanced' \| 'max' | 'auto' | Screenshot JPEG quality preset. 'auto' picks based on failure volume; 'none' keeps original PNGs; 'balanced' uses JPEG q85; 'max' uses JPEG q70. |
| includeScreenshots | boolean | true | Embed Playwright screenshots in the PDF. Set to false to omit images; useful for exec-audience reports or reducing file size. |
| maxInlineFailures | number | derived from compressionLevel | Cap on failure entries rendered inline in the PDF. Overflow is written to a sibling {basename}-failures.json sidecar file. |
| maxFileSizeMb | number | 8 | Soft cap on the final PDF size in MB. If exceeded, the report is re-rendered once with the 'max' compression preset. |
| shardResults | string \| string[] | n/a | Glob or path array of Playwright JSON shard report files to merge into one PDF. See the Shard Merging docs. |
| notify | object | n/a | Notification channels: slack, teams (each { url, enabled, on }), discord ({ url, enabled, on, attachPdf }), email ({ to, enabled, on, attachPdf }). See the Notifications docs. |
| failureAnalysis | object | { enabled: true } | Offline failure root-cause analysis (embedded classifier; no runtime network) with on-device personalization: label collected failures, then the train-model CLI trains + evaluates a local layer entirely on your machine; it activates only when it beats the base model, and nothing leaves the machine. Fields: enabled (default true), maxClusters (default 10), minStrength (weak|moderate|strong, default weak), maxFailuresToAnalyse (default 500), collectUnclassified (default true), collectScope (blind-spots|all, default blind-spots), autoUpdateModel (default true), localModel (use the gate-passed on-device model, default true), localModelPath (share a team-trained model via a repo-committed file). See the Failure Analysis docs. |
| capture | object | {} (off) | Opt-in rich execution capture for the defect log (reporter-side; no fixtures, no test-code changes). Fields: steps (a copy-pasteable "Steps to Reproduce" outline built from the Playwright step tree; each row is a Markdown list line indented under its parent test.step, default false), apiSteps (include every top-level pw:api action (click/fill/check/goto) in the outline for a full action trail; without it the outline shows only test.step intent + expect assertions, default false), console (Node stdout/stderr tail, default false), evidence (trace/video file links, default false), maxSteps (default 50), maxConsoleLines (default 50). Renders in the Defect Log section of the detailed template. |
| live | object | {} (off) | Opt-in live test-execution streaming. When enabled, the reporter prints an unguessable watch link to the CI logs at run start and streams per-test progress to the hosted dashboard while tests run; all shards of one CI run converge on a single live view. Fields: enabled (default false), runId (override the auto-derived run id), serverUrl (override the streaming server), steps (none|failed|intent|all, default failed; intent shows only your test.step names plus any failing step), console (stream stdout/stderr tails, default false), flushMs (batch debounce 500-10000, default 2000). The PDF at the end of the run is unaffected. Requires an active subscription with the live entitlement. See the Live Runs docs. |
| historyFile | string | ~/.reportforge/{key}/history.json | Path to the history JSON file. Relative paths resolve from cwd. Enables pass-rate trending charts in the detailed template. |
| historySize | number | 10 | Maximum number of test runs to keep in the history file (integer ≥ 2). Older runs are pruned on append. |
| showTrend | boolean | true | Show the pass-rate sparkline and delta badge in the detailed template. Set to false to disable history tracking entirely. |
| remoteHistory | boolean | false | Opt-in server-side trend store so the pass-rate trend survives ephemeral CI runners (the local history file is wiped with the workspace, leaving the chart stuck at one data point). One small authenticated request per run carrying aggregate numbers only — no test titles, no error text, and the branch name never travels in plaintext. Falls back to the local history file on any failure. See the History docs. |
| flakinessTopN | number | 5 | Maximum flaky tests to show in the flakiness table (detailed template). Set to 0 to disable the table entirely. |
| slowTestThreshold | number | 10 | Minimum timed-test count before SLOW badges appear in the suite breakdown: below this, every test is trivially the "slowest" so badges stay hidden. On larger runs only genuine outliers (at least 2× the median test duration) are badged, so the badge stays rare. Set to 0 to drop the run-size gate (outliers still required). |
| requirementTagPattern | string | '^@?[A-Z][A-Z0-9]*-\\d+$' | Regex deciding which tags count as requirement IDs in the Requirements Traceability section (detailed template). Matching tags (ticket shapes like @ODP-5328, REQ-001) get the traceability matrix; everything else (@regression, @sanity) collapses into a compact tag summary instead of repeating identical rows. Set to '' to disable the split and list every tag in the matrix. |
| templatePath | string \| string[] | n/a | Path to a custom Handlebars (.hbs) template file. Takes precedence over template. Pass an array to generate one PDF per custom template. See the Custom Templates docs. |
| sections | object | per-template | Override which report sections appear, on top of the chosen template's defaults. Flat keys are the baseline for every chosen template; per-template keys (minimal|detailed|executive) override per template. Block toggles: coverPage, analysisOneliner, releaseGate, summary, charts, trend, requirementsMatrix, ciEnvironment, suiteBreakdown, failureDeepDive, failureAnalysis, slowTests, defectLog, briefBand. Display modifiers: passRate, fullEnvironment, retries, fullFailures, stackTraces. See the Report Sections docs. |
Full reference: reportforge.org/docs/configuration.
Live Runs
Watch a run as it happens. With live enabled, the reporter prints an unguessable watch link (boxed under a Live Tracker heading) to your CI logs at run start and streams per-test progress to a hosted dashboard while tests execute. All shards of one CI run converge on a single live view. Each test shows its steps and assertions as sub-lines beneath its row: each step once, as it settles, indented under its parent test.step in source order (Playwright's hooks, fixtures, and teardown are filtered out). The PDF is still generated at the end, unchanged.
The watch link is entitlement-gated. If you enable
livebut see noLive Trackerline, the reporter logs why (missingRF_LICENSE_KEY, or a cached token without theliveentitlement; delete~/.reportforge/license.jsonto force re-activation).
// playwright.config.ts
reporter: [
['@reportforge/playwright-pdf', {
outputFile: 'reports/{date}-report.pdf',
live: {
enabled: true,
steps: 'failed', // 'none' | 'failed' | 'intent' | 'all'
// console: false, // stream stdout/stderr tails (off by default; see note)
// flushMs: 2000, // batch debounce (500-10000)
},
}],
],steps: 'intent' shows only your test.step names (plus any failing step): the cleanest, most readable trail. 'all' adds every action and assertion beneath its parent step; 'failed' (default) keeps intent + assertions + failures.
Sharded runs need no extra config: every shard of one CI run converges on the same live view automatically. Set RF_LIVE_RUN_ID to override when your CI is not auto-detected.
Live streaming is best-effort and entitlement-gated: if the server is unreachable the run is unaffected, and an active subscription with the live feature is required. If you've configured Slack/Teams/Discord notifications, the watch link is also posted to those channels when the run starts.
Security: the watch link exposes test titles + statuses (and step titles when
stepsis on). Leavingconsole: falseis recommended: enabling it streams your tests' stdout/stderr to anyone holding the link. Full details at reportforge.org/docs/advanced/live.
Shard Merging
Combine parallel Playwright shards into one PDF without re-running any tests.
Workflow:
- Run each shard with
--reporter=jsonto produce a JSON output file. - In a separate step, point
shardResultsat those files; it accepts a glob or an explicit array.
// playwright.config.ts (merge step)
reporter: [
['@reportforge/playwright-pdf', {
shardResults: 'results/shard-*.json', // glob
// or: shardResults: ['results/shard-1.json', 'results/shard-2.json'],
outputFile: 'reports/{date}-report.pdf',
}],
],The merge step can run against a dummy test file with zero tests: shardResults takes precedence over live results.
Note: Timed-out tests are counted as failures in shard mode (Playwright JSON stats do not distinguish
timedOutfromfailed).
Notifications
Post a summary to Slack, Teams, Discord, or email after each run.
notify: {
slack: {
url: process.env.SLACK_WEBHOOK_URL,
enabled: true,
on: 'failure', // 'always' | 'failure' | 'success' (default: 'always')
},
teams: {
url: process.env.TEAMS_WEBHOOK_URL,
enabled: true,
on: 'always',
},
discord: {
url: process.env.DISCORD_WEBHOOK_URL,
enabled: true,
on: 'failure',
attachPdf: true, // upload the PDF with the message (default: false)
},
email: {
to: ['[email protected]', '[email protected]'],
enabled: true,
on: 'failure',
attachPdf: false, // set true to attach the generated PDF
},
},Each channel is independent. enabled: false (the default) lets you store a URL without activating it; useful for staging configs.
The on trigger controls when the message fires:
| Value | Sends when |
|---|---|
| 'always' | Every run |
| 'failure' | stats.failed > 0 or run timed out / interrupted |
| 'success' | All tests passed |
Email requires RESEND_API_KEY in the environment (get one at resend.com). Sender defaults to [email protected]; override with RESEND_FROM. Store webhook URLs and API keys as CI secrets; never commit them.
PDF attachment (attachPdf: true) is available on email and discord: Slack and Teams webhooks cannot carry file uploads. On Discord the PDF is uploaded with the message; if the upload fails or the PDF exceeds Discord's file-size cap, the summary still posts without the attachment. With multiple templates, the first PDF is attached.
The summary includes pass rate, test counts, duration, and the report filename. Notifications require a valid license and fire after PDF generation (or after a PDF failure; you still get the ping).
Test History Trending
After each run the reporter appends a summary entry to a local JSON file and renders a pass-rate sparkline + verdict row in the detailed template.
Local dev (zero config): history is written automatically to ~/.reportforge/{projectKey}/history.json. The sparkline appears once two or more runs have been recorded.
CI with ephemeral runners (recommended): enable the server-side trend store; the local file is wiped with the workspace, leaving the chart stuck at one data point:
reporter: [['@reportforge/playwright-pdf', {
template: 'detailed',
remoteHistory: true,
}]]One small authenticated request per run, carrying aggregate numbers only (pass rate, counts, duration, verdict; no test titles, no error text, and the branch name never travels in plaintext). The server keeps roughly the last 100 runs per project + branch, expiring after 180 days, and returns them for the chart; any failure falls back to the local file. The flakiness table stays local-only by design (it needs test titles, which never leave your machine). Bitbucket Pipelines users especially: Bitbucket caches are immutable once written, so remoteHistory is the practical path there.
CI caching alternative (keeps even aggregate numbers off the server): set historyFile to a project-relative path and cache it between runs:
// playwright.config.ts
reporter: [['@reportforge/playwright-pdf', {
template: 'detailed',
historyFile: '.reportforge/history.json',
}]]# .github/workflows/test.yml
- uses: actions/cache@v4
with:
path: .reportforge/history.json
key: reportforge-history-${{ github.ref }}
# Omit restore-keys; cross-branch fallback causes misleading sparklines on PRsMonorepo: each package needs a distinct historyFile (e.g. .reportforge/api-history.json, .reportforge/web-history.json) so runs do not overwrite each other.
Flakiness Trend Table
The detailed template includes a Top flaky tests table showing which tests flake most often across your stored history. Each row shows the test name, flake rate (%), run count, and a dot sparkline (amber dot = flaky in that run).
reporter: [['@reportforge/playwright-pdf', {
template: 'detailed',
flakinessTopN: 5, // default: show top 5; set 0 to disable
}]]The table is gated behind showTrend: true (the default) and appears automatically once history entries are present. Runs written before the flakiness feature was added are excluded from the denominator; the table fills in correctly as newer runs accumulate. Set flakinessTopN: 0 to hide the table entirely.
Filename tokens
| Token | Replaced with | Example |
|---|---|---|
| {date} | YYYY-MM-DD (UTC) | 2026-04-21 |
| {branch} | Git branch, sanitised | feature-auth |
| {status} | Overall verdict | passed / failed / timedout / interrupted |
Templates
minimal: Developer-focused
Clean layout, KPI numbers, hierarchical test table, failure details with stack traces and embedded screenshots. Fast to generate. Good for local development and PR checks.
detailed: QA Team
Everything in minimal, plus Chart.js pass-rate + suite-results charts, a numbered defect log, a requirements traceability matrix derived from @TAG annotations, and the full CI/CD environment table.
executive: Stakeholder presentations
Full-page cover with verdict + KPI strip, followed by a compact dashboard with charts and a failures summary (titles only, no raw stack traces). Best for sprint reports and management dashboards.
Shared across all three
Every report leads with a release-gate ship/hold banner derived from the run verdict, surfaces timed-out tests as their own KPI card and pass-rate chart slice, and lists failures most-severe first (with severity-coloured card borders in minimal and detailed). Pages pack compactly: large sections flow and break between rows instead of each starting on a fresh page. The Suite Results chart breaks a single-file run down by describe block so it never collapses to one bar. Requirements coverage bars are coloured by threshold (red <50%, amber <80%, green ≥80%).
Generating multiple templates in one run
Pass an array to template to generate one PDF per template from a single test run. The template name is appended to the output filename automatically:
// playwright.config.ts
reporter: [
['@reportforge/playwright-pdf', {
template: ['detailed', 'executive'],
outputFile: 'reports/{date}-report.pdf',
licenseKey: process.env.RF_LICENSE_KEY,
}],
]# → reports/2026-04-28-report-detailed.pdf
# → reports/2026-04-28-report-executive.pdfOne license check, one data-collection pass: faster than multiple reporter instances. Duplicate entries are silently deduplicated.
Report Sections
Each built-in template ships a curated set of sections. The sections option lets you add a section a template hides or remove one it shows, per template, without writing a custom template.
reporter: [['@reportforge/playwright-pdf', {
template: ['minimal', 'detailed'],
sections: {
defectLog: false, // flat key: baseline for EVERY chosen template
minimal: { charts: true }, // per-template key: overrides the baseline
detailed: { ciEnvironment: false },
},
}]]Resolution order (lowest → highest): the template's defaults → flat keys (baseline for all chosen templates) → per-template keys (minimal / detailed / executive). An unknown key throws a configuration error (typo-safe).
Block toggles: which sections appear
| Key | Renders |
|---|---|
| coverPage | Full-page cover: title, verdict badge, KPI stats strip, branch + commit |
| analysisOneliner | One-line failure-analysis summary banner |
| releaseGate | Ship/hold recommendation banner (APPROVED TO SHIP / HOLD, or a neutral NO TESTS RAN when the run executed zero tests) |
| summary | KPI strip (total · passed · failed · timed-out · skipped · flaky), verdict, duration, pass rate, flaky callout |
| charts | Pass-rate doughnut + stacked suite-results bar |
| trend | Pass-rate trend line, run-history table, and flakiness table (rendered inside charts) |
| requirementsMatrix | Requirement-ID tags as a traceability matrix with pass-rate bars, plus a category tag summary |
| ciEnvironment | Branch, commit, browsers, CI provider, OS, Node, Playwright, projects, workers |
| suiteBreakdown | Per-suite → per-test table (status, duration, tags, retries). Failed tests carry their failure detail, root-cause chip, and a SLOW badge inline (the three keys below) |
| failureDeepDive | Inline failure detail under each failed test in the breakdown: error message, stack trace, screenshot, retry history |
| failureAnalysis | Inline per-test root-cause chip under each failed test (category + representative error + match strength, from the offline classifier) |
| slowTests | SLOW badge on the duration-ranked slowest tests, shown inline in the breakdown |
| defectLog | DEF-#### numbered failure table (severity, duration) + opt-in repro detail (capture) |
| briefBand | Executive brief band: one plain-language sentence (trend delta + root causes) and a hero pass-rate stat |
Display modifiers: tune a section that's on
| Key | Effect |
|---|---|
| passRate | Show the pass-rate % on the Passed KPI card (summary) |
| fullEnvironment | Full environment table instead of the compact grid (ciEnvironment) |
| retries | Retries column in the suite breakdown (suiteBreakdown) |
| fullFailures | Include the screenshot in the inline failure detail (compact templates omit it) (failureDeepDive) |
| stackTraces | Include <pre> stack traces in the inline failure detail (failureDeepDive) |
Per-template defaults
Omit sections entirely and each template renders exactly this (✓ = on):
| Section | minimal | detailed | executive |
|---|:-:|:-:|:-:|
| coverPage | – | – | ✓ |
| analysisOneliner | – | – | – |
| releaseGate | ✓ | ✓ | ✓ |
| summary | ✓ | ✓ | ✓ |
| charts | – | ✓ | ✓ |
| trend | – | ✓ | ✓ |
| requirementsMatrix | – | ✓ | – |
| ciEnvironment | ✓ | ✓ | ✓ |
| suiteBreakdown | ✓ | ✓ | ✓ |
| failureDeepDive | ✓ | ✓ | ✓ |
| failureAnalysis | – | ✓ | – |
| slowTests | – | ✓ | ✓ |
| defectLog | – | ✓ | – |
| briefBand | – | – | ✓ |
| passRate | ✓ | ✓ | ✓ |
| fullEnvironment | – | ✓ | – |
| retries | ✓ | ✓ | – |
| fullFailures | ✓ | ✓ | – |
| stackTraces | ✓ | ✓ | – |
Dependencies & gotchas
trendneedscharts. The trend line, run-history, and flakiness table live inside the charts block, sotrend: truedoes nothing withcharts: false(it's coerced off). It also needs history data; keep the top-levelshowTrendoption on.- Inline failure detail needs
suiteBreakdown.failureDeepDive(failure detail),failureAnalysis(root-cause chip), andslowTests(SLOWbadge) now render inside the suite breakdown, so they show nothing whensuiteBreakdownis off. The chip (failureAnalysis) also needsfailureDeepDive: it lives inside the failure detail, so it's coerced off without it. - Data-gated sections:
failureAnalysis,requirementsMatrix,slowTests,defectLogrender only when there's matching data (classified failures, tagged tests, a meaningful slow set, failures). Toggling them on with no data shows nothing. - Render-layer only.
sectionscontrols what's drawn, never what's collected; the data switches stay separate:showTrend(history),flakinessTopN(flaky-table size),failureAnalysis.enabled(classifier),includeScreenshots(images). - Custom templates.
sectionsapplies to the built-in templates; a customtemplatePathcontrols its own layout (every section available) and ignoressections. You'll get a warning if both are set.
CI/CD Integration
Full workflows for all four CI providers: reportforge.org/docs/ci-cd.
GitHub Actions
- name: Run Playwright tests
run: npx playwright test
env:
RF_LICENSE_KEY: ${{ secrets.RF_LICENSE_KEY }}
PUPPETEER_EXECUTABLE_PATH: /usr/bin/google-chrome-stable
- name: Upload PDF report
if: always()
uses: actions/upload-artifact@v4
with:
name: playwright-pdf-report
path: reports/*.pdfGitHub Actions: Sharded runs
Run shards in parallel with --reporter=json, then merge all JSON files into one PDF:
jobs:
test:
strategy:
matrix:
shard: [1, 2, 3, 4]
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with: { node-version: '20' }
- run: npm ci
- run: npx playwright test --shard=${{ matrix.shard }}/4 --reporter=json
env:
PLAYWRIGHT_JSON_OUTPUT_NAME: results/shard-${{ matrix.shard }}.json
- uses: actions/upload-artifact@v4
with:
name: shard-json-${{ matrix.shard }}
path: results/shard-${{ matrix.shard }}.json
merge-pdf:
needs: test
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with: { node-version: '20' }
- run: npm ci
- uses: actions/download-artifact@v4
with: { pattern: shard-json-*, merge-multiple: true, path: results }
- run: npx playwright test --reporter=@reportforge/playwright-pdf tests/dummy.spec.ts
env:
RF_LICENSE_KEY: ${{ secrets.RF_LICENSE_KEY }}
PUPPETEER_EXECUTABLE_PATH: /usr/bin/google-chrome-stable
SHARD_RESULTS_GLOB: 'results/shard-*.json'
- uses: actions/upload-artifact@v4
with: { name: playwright-pdf-report, path: reports/*.pdf }In playwright.config.ts set shardResults: process.env.SHARD_RESULTS_GLOB. tests/dummy.spec.ts can be a single skipped test: live results are ignored when shardResults is set.
GitLab CI
playwright-tests:
image: mcr.microsoft.com/playwright:v1.49.0-jammy
script:
- npm ci && npx playwright test
artifacts:
paths: [reports/*.pdf]
when: always
expire_in: 30 daysBitbucket Pipelines
image: mcr.microsoft.com/playwright:v1.49.0-jammy
pipelines:
default:
- step:
name: Playwright Tests + PDF Report
caches: [node]
script:
- npm ci
- npx playwright test
artifacts:
- playwright-report/*.pdfSet RF_LICENSE_KEY in Repository Settings → Repository variables.
Jenkins
stage('Playwright Tests') {
withCredentials([string(credentialsId: 'rf-license', variable: 'RF_LICENSE_KEY')]) {
sh 'npx playwright test'
}
archiveArtifacts artifacts: 'reports/*.pdf', allowEmptyArchive: true
}Azure DevOps
- script: npx playwright test
env: { RF_LICENSE_KEY: $(RF_LICENSE_KEY) }
- task: PublishPipelineArtifact@1
inputs:
targetPath: reports
artifact: playwright-pdf-reportLicensing
ReportForge ships a hybrid offline-first model:
- Paste your
RFSU-…key into the config once (or setRF_LICENSE_KEY). - On first run the reporter activates against the license server and caches a signed license at
~/.reportforge/license.json. - Every subsequent run is fully offline: the cached license is validated on-device. No network call.
- The reporter refreshes the cache automatically in the background before it expires.
- Each subscription allows up to 25 active machines. Machines that haven't run in 30 days free up automatically.
Cancel the subscription and the reporter keeps working until the end of the current billing period, then stops generating PDFs until you restart. A license issue never aborts your test run: the reporter logs a warning and skips PDF generation; your Playwright tests still pass.
export RF_LICENSE_KEY=RFSU-XXXX-XXXX-XXXX-XXXX
npx playwright testFull lifecycle + offline failure modes: reportforge.org/docs/licensing.
Requirements Traceability
The detailed template generates a requirements matrix from test tags. Tag tests with ticket-shaped IDs to link them to requirements:
test('user can login', { tag: ['@REQ-101', '@smoke'] }, async ({ page }) => { /* ... */ });
test.describe('payment', { tag: '@PAY-204' }, () => { /* ... */ });Tags matching requirementTagPattern (default: ticket shapes like @REQ-101, @ODP-5328, JIRA-42) each get a matrix row — test count, pass/fail counts, and a pass-rate bar — sorted by ID. Category tags (@smoke, @regression) collapse into a compact tag summary below the matrix instead of repeating one near-identical row per tag. Set requirementTagPattern: '' to disable the split and list every tag in the matrix.
Troubleshooting
Set RF_DEBUG=1 to log the full activation flow and error stack traces:
RF_DEBUG=1 npx playwright test 2>&1 | grep '\[reportforge\]'Controlling log output
The logLevel option sets how chatty the reporter's [reportforge] console lines are:
['@reportforge/playwright-pdf', { logLevel: 'warn' }] // warnings and errors only'debug'prints the same diagnostics asRF_DEBUG=1— useful in CI where env vars are awkward to set.'silent'suppresses everything, including error lines: a failed PDF then surfaces only as a missing file, because the reporter never fails your test run.RF_DEBUG=1always forces debug output, overridinglogLevel— it is the support escape hatch, so "setRF_DEBUG=1and send the log" works no matter what the config says.
Common issues:
Chrome/Chromium not found→ install Google Chrome Stable; don't use the Ubuntuchromium-browsersnap.- Charts blank → ensure
npm run bundle-chartjsran at build; the reporter waits up to 30s forwindow.__chartsReady. pdfPasswordignored → requiresqpdfonPATH(apt install qpdf/brew install qpdf/choco install qpdf).- No PDF generated → verify
RF_LICENSE_KEYis set and your subscription is active.RF_DEBUG=1will show the activation result; missing key, expired subscription, network failure, or no license cache all skip PDF generation.
Full guide: reportforge.org/docs/troubleshooting.
Documentation
Full documentation at reportforge.org/docs:
- Quick start: install, configure, activate
- Chrome setup: Windows, Linux, macOS
- CI/CD integration: GitHub Actions, GitLab CI, Bitbucket Pipelines, Jenkins, Azure DevOps
- Configuration reference: all options
- Filename tokens:
{date},{branch},{status} - Templates: minimal, detailed, executive
- Live runs: stream per-test progress to a shared watch link
- Report Sections: add or remove sections per template
- License & offline behaviour: license cache, machine cap, cancellation
- Troubleshooting: common issues and debug flags
- Changelog: version history and release notes
Contributing
Questions and bug reports: email [email protected].
Security
Found a vulnerability? Email [email protected] with a subject starting with [SECURITY] — please don't open a public issue. Details, scope, and response timelines are in SECURITY.md; machine-readable contact data is at reportforge.org/.well-known/security.txt.
License
Elastic License 2.0. The license does not allow offering the software as a hosted service, bypassing or removing the license-key check, or stripping license or copyright notices. Generating PDF reports requires an active subscription.
