@clipboard-health/playwright-reporter-llm

Playwright reporter that outputs structured JSON for LLM agents. Minimal console output, flat schema, easy to filter to failures.

Table of contents

• Install
• Usage
• Local development commands

Install

npm install @clipboard-health/playwright-reporter-llm
Copy

// playwright.config.ts
import { defineConfig } from "@playwright/test";

export default defineConfig({
  reporter: [
    ["@clipboard-health/playwright-reporter-llm", { outputFile: "test-results/llm-report.json" }],
  ],
});
Copy

Usage

Options

Console output

.......F..........F.S....
26 tests | 23 passed | 2 failed | 1 skipped (4.2s)
Report: test-results/llm-report.json
Copy

Report schema

{
  "schemaVersion": 1,
  "timestamp": "2026-02-25T19:00:00.000Z",
  "durationMs": 4200,
  "summary": {
    "total": 26,
    "passed": 23,
    "failed": 2,
    "flaky": 0,
    "skipped": 1,
    "timedOut": 0,
    "interrupted": 0
  },
  "environment": {
    "playwrightVersion": "1.58.2",
    "nodeVersion": "v24.13.1",
    "os": "darwin",
    "workers": 4,
    "retries": 1,
    "projects": ["chromium"]
  },
  "tests": [
    {
      "id": "abc123",
      "title": "Suite > should work",
      "status": "failed",
      "flaky": false,
      "durationMs": 150,
      "location": { "file": "tests/example.spec.ts", "line": 10, "column": 5 },
      "project": "chromium",
      "tags": [],
      "annotations": [],
      "retries": 1,
      "errors": [
        {
          "message": "Expected: 1, Received: 2",
          "stack": "...",
          "diff": { "expected": "1", "actual": "2" },
          "location": { "file": "tests/example.spec.ts", "line": 12, "column": 5 }
        }
      ],
      "attachments": [
        { "name": "screenshot", "contentType": "image/png", "path": "screenshot.png" }
      ],
      "stdout": "",
      "stderr": ""
    }
  ],
  "globalErrors": []
}
Copy

Key fields for agents:

• summary -- quick pass/fail counts
• tests[].errors[].message -- ANSI-stripped, clean error text
• tests[].errors[].diff -- extracted expected/actual from assertion errors
• tests[].errors[].location -- exact file and line of failure
• tests[].flaky -- true if test passed after retry
• tests[].attachments[].path -- relative to Playwright outputDir
• stdout/stderr -- capped at 4KB with [truncated] marker

Local development commands

See package.json scripts for a list of commands.