Files
open-wc/docs/M00_FINAL_PAIRED_EVIDENCE.md

4.0 KiB

M00 Final Paired Evidence — 2026-07-12

Scope and result

The final local M00 audit used Godot 4.6.1, the existing cache state, the manifest-standard 8-second readiness wait, and 2560x1440 visual candidates. Five private WoW 3.3.5a build 12340 references produced ten cold/warm comparisons with no missing pair. Private images and generated reports remain outside Git.

The command completed even though every pair exceeded the strict regression tolerance. Comparator exit code 1 means a valid report with visual gaps; only codes outside 0/1 are infrastructure failures.

.\tools\run_render_baseline.ps1 `
  -Output user://render_baseline_m00_final_2026-07-12 `
  -CacheState existing `
  -WaitSeconds 8 `
  -MeasureSeconds 0.5 `
  -ReferenceCheckpointDirectory .\sources\OpenWCReferenceCheckpoints `
  -VisualComparisonReport user://render_baseline_m00_final_2026-07-12/visual_comparison.json `
  -VisualComparisonWidth 2560 `
  -VisualComparisonHeight 1440

Paired metrics

Checkpoint Pass Mean perceptual error Changed-pixel ratio Classification
elwynn_adt_boundary cold 0.087347 0.634984 Composition plus terrain/vegetation/material gaps
elwynn_adt_boundary warm 0.087255 0.634598 Stable against revisit
elwynn_terrain_overview cold 0.174136 0.851806 Largest composition/framing gap
elwynn_terrain_overview warm 0.176952 0.861275 Stable gap, not a cold-load artifact
elwynn_waterfall_liquid cold 0.088526 0.706897 Framing, terrain, liquid and lighting gaps
elwynn_waterfall_liquid warm 0.087490 0.695281 Stable against revisit
goldshire_dense_m2 cold 0.066892 0.575205 Smallest available paired gap; vegetation/material differences remain
goldshire_dense_m2 warm 0.066927 0.575547 Stable against revisit
goldshire_inn_large_wmo cold 0.101230 0.701836 WMO is ready; manual framing and presentation gaps remain
goldshire_inn_large_wmo warm 0.101203 0.701855 Stable against revisit

Cold and warm values are close for all five references. The paired gaps are therefore not explained by first-visit cache readiness. Goldshire timing evidence separately demonstrated that the 8-second wait is necessary for WMO publication.

Fidelity interpretation

M00 now has reproducible quantitative evidence for terrain, ADT boundary, dense M2, large WMO and liquid checkpoints. The reports demonstrate current differences; they do not claim renderer parity. Camera calibration experiments also show that unknown manual yaw/pitch/FOV cannot be recovered reliably from full-frame color error alone. Region scoring reduces terrain bias but still requires semantic landmark approval.

Two manifest checkpoints still lack original-client paired references:

  • gryphon_roost_native_animation is a synthetic native-animation probe and has no matching build 12340 fixture.
  • elwynn_sky_dusk has no approved build 12340 sky-transition fixture at the same time/weather state.

These must either receive private reference evidence or be explicitly accepted by the milestone integrator as unpaired diagnostic coverage. Until that decision, the target remains ACTIVE.

Operational risks

The full GUI capture completed and wrote both reports, but Godot still emitted renderer RID/resource leak diagnostics at exit. The earlier anonymous headless RefCounted leak is fixed; GUI renderer allocations are a distinct known risk. They do not invalidate the written images or metrics, but must remain recorded rather than hidden.

Integrator decision checklist

  • Five available reference checkpoints: paired cold/warm report complete, missing pairs zero.
  • Animated M2 fixture: missing or explicitly accepted as synthetic-only.
  • Sky-transition fixture: missing or explicitly accepted as unpaired.
  • Renderer visual differences: registered as gaps, not parity claims.
  • GUI renderer RID/resource diagnostics: accepted as a tracked risk or assigned a follow-up blocker.
  • Target status and OPENWC_TARGET_DONE marker: integrator-only action.