Files
open-wc/docs/M00_FINAL_PAIRED_EVIDENCE.md
sindoring 0327e4862d test(M00): complete animation and sky evidence
Work-Package: M00-QAR-ANIMATION-SKY-EVIDENCE-001
Agent: sindo-main-codex
Tests: 14-pair visual audit; manifest/self-test; coordination/documentation gates
Fidelity: sky evidence paired approximately; Gryphon animation observed but placement-unpaired
2026-07-13 10:01:19 +04:00

6.1 KiB

M00 Final Paired Evidence — 2026-07-13

Scope and result

The final local M00 audit used Godot 4.6.1, the existing cache state, the manifest-standard 8-second readiness wait, and 2560x1440 visual candidates. Seven private WoW 3.3.5a build 12340 references produced fourteen cold/warm comparisons with no missing pair. Private images and generated reports remain outside Git.

Every pair exceeded the strict regression tolerance. Comparator exit code 1 means a valid report with measured visual gaps; only codes outside 0/1 are infrastructure failures. This evidence establishes coverage and current differences, not renderer parity.

.\tools\run_render_baseline.ps1 `
  -Output user://render_baseline_m00_complete_2026-07-13 `
  -CacheState existing `
  -WaitSeconds 8 `
  -MeasureSeconds 0.5 `
  -ReferenceCheckpointDirectory .\sources\OpenWCReferenceCheckpoints `
  -VisualComparisonReport user://render_baseline_m00_complete_2026-07-13/visual_comparison.json `
  -VisualComparisonWidth 2560 `
  -VisualComparisonHeight 1440

The initial shell timeout detached the canonical capture process after it started. The process completed all fourteen canonical captures and wrote report.json; the documented visual-capture and comparator stages were then invoked separately with the same arguments. The final output directory contains both complete reports.

Paired metrics

Checkpoint Pass Mean perceptual error Changed-pixel ratio Classification
elwynn_adt_boundary cold 0.087258 0.634580 Composition plus terrain/vegetation/material gaps
elwynn_adt_boundary warm 0.087255 0.634598 Stable against revisit
elwynn_sky_dusk cold 0.094778 0.575956 Approximate paired camera; sky color, lighting and scene-composition gaps
elwynn_sky_dusk warm 0.094757 0.575898 Stable against revisit
elwynn_terrain_overview cold 0.174137 0.851791 Largest composition/framing gap
elwynn_terrain_overview warm 0.176955 0.861271 Stable gap, not a cold-load artifact
elwynn_waterfall_liquid cold 0.088629 0.706522 Framing, terrain, liquid and lighting gaps
elwynn_waterfall_liquid warm 0.087398 0.693690 Stable against revisit
goldshire_dense_m2 cold 0.066893 0.575257 Smallest available paired gap; vegetation/material differences remain
goldshire_dense_m2 warm 0.066927 0.575592 Stable against revisit
goldshire_inn_large_wmo cold 0.101224 0.701835 WMO is ready; manual framing and presentation gaps remain
goldshire_inn_large_wmo warm 0.101206 0.701855 Stable against revisit
gryphon_roost_native_animation cold 0.119467 0.882073 Same build-12340 asset, different real/synthetic placement and uncontrolled animation phase
gryphon_roost_native_animation warm 0.119471 0.882076 Full-frame metric is diagnostic only; animation observation is human evidence

Cold and warm values are close for all seven references. The measured gaps are therefore not explained by first-visit cache readiness. Goldshire timing evidence separately demonstrated that the 8-second wait is necessary for WMO publication.

Animation and sky provenance

The private source corpus preserves exact screenshot bytes; no resize, crop or generated content was used:

Evidence SHA-256 Interpretation
elwynn_sky_dusk.jpg 1fb06836cacae714c76eaf9b8bf7c292fd5e2f2df33eef821bfe4c4a6bd97072 Build 12340, Elwynn camera position, server time approximately 19:00, UI hidden
gryphon_roost_native_animation.jpg d3488c741cb8dfe7212198e48332842631a951862a4388b67045338f37357447 Build 12340 real-world GryphonRoost01 placement, first visible wing phase
diagnostic animation phase B 1025572c7ab9fa0d2e500ff026be46eb9c1e6e5447116dbdc3675dd5f44574ab Same camera three seconds later; visibly raised wing phase
diagnostic placement context b12c0b713a7d75123ed30f5a316b33537331442cd56615aea69214c7cc4e7a42 Two real Lakeshire placements and surrounding build-12340 scene

An ADT scan found no GryphonRoost01 placement in Goldshire. The M00 checkpoint deliberately injects the model there as a synthetic probe. The original-client observation therefore uses two real Lakeshire placements. The three-second pose change establishes Observed native animation behavior, but the full-frame comparison cannot establish spatial or animation-phase parity.

Fidelity interpretation

M00 now has private build 12340 evidence for every required coverage category: terrain, ADT boundary, dense M2, large WMO, liquid, animated M2 and sky transition. The sky reference is approximately paired by map position/time and manually approved composition. Animated-M2 evidence is asset-paired but placement-unpaired because the OpenWC probe is synthetic.

The reports demonstrate current differences and do not claim 1:1. Camera calibration experiments also show that unknown manual yaw/pitch/FOV cannot be recovered reliably from full-frame color error alone. Region scoring reduces terrain bias but still requires semantic landmark approval.

Operational risks

The full GUI visual capture completed and wrote its report, but Godot still emitted renderer RID/resource leak diagnostics at exit, including leaked material, shader, texture, instance and rendering-device RIDs. The earlier anonymous headless RefCounted leak is fixed; these GUI renderer allocations are a distinct known risk. They do not invalidate the written images or metrics, but must remain recorded rather than hidden.

Integrator decision checklist

  • Seven required reference checkpoints: cold/warm report complete, compared=14, missing=0.
  • Animated M2: build-12340 native motion observed in two phases; synthetic/real placement mismatch explicitly classified.
  • Sky transition: build-12340 19:00 evidence present with approximate paired camera and human-approved composition.
  • Renderer visual differences: registered as gaps, not parity claims.
  • GUI renderer RID/resource diagnostics: accepted as a tracked risk or assigned a follow-up blocker.
  • Target status, target Evidence and OPENWC_TARGET_DONE marker: integrator-only actions.