QA Evidence Engine

Live vs Staging regression proof, not a green checkbox.

A local Node.js Playwright CLI that pairs equivalent routes, captures screenshots, traces, network, SEO, accessibility, and performance evidence, then recommends a release gate. No evidence, no PASS.

4Honest statuses
8+Add-on audits
0Fabricated results
LocalReproducible runs

Verdict model

PASS

Required assertions succeeded and required evidence was captured.

FAIL

A required assertion failed or a threshold was breached. Shared Live+Staging failure is still FAIL.

INCONCLUSIVE

The evidence cannot establish the outcome. Missing artifacts cannot become PASS.

NOT TESTED

The test did not run. Missing staging credentials skip cart and checkout instead of faking success.

Run it locally

npm install
npx playwright install chromium
npm run qa -- validate
npm run qa -- test-engine
npm run qa -- run

Reports land in reports/<run-id>/ as HTML, JSON, PDF, screenshots, traces, and a SHA-256 manifest. Live stays read-only. Staging mutations need QA_STAGING_USER and QA_STAGING_PASS.

Operating principle

This showcase page describes a local evidence engine. It does not claim that Naseej Live or Staging was certified in this environment. A successful fixture self-test proves honest verdicts on controlled pages, not that every production path is defect-free.