|
|
|
@@ -1,60 +1,74 @@
|
|
|
|
|
# M00 Final Paired Evidence — 2026-07-12
|
|
|
|
|
# M00 Final Paired Evidence — 2026-07-13
|
|
|
|
|
|
|
|
|
|
## Scope and result
|
|
|
|
|
|
|
|
|
|
The final local M00 audit used Godot 4.6.1, the existing cache state, the manifest-standard 8-second readiness wait, and `2560x1440` visual candidates. Five private WoW 3.3.5a build 12340 references produced ten cold/warm comparisons with no missing pair. Private images and generated reports remain outside Git.
|
|
|
|
|
The final local M00 audit used Godot 4.6.1, the existing cache state, the manifest-standard 8-second readiness wait, and `2560x1440` visual candidates. Seven private WoW 3.3.5a build 12340 references produced fourteen cold/warm comparisons with no missing pair. Private images and generated reports remain outside Git.
|
|
|
|
|
|
|
|
|
|
The command completed even though every pair exceeded the strict regression tolerance. Comparator exit code `1` means a valid report with visual gaps; only codes outside `0/1` are infrastructure failures.
|
|
|
|
|
Every pair exceeded the strict regression tolerance. Comparator exit code `1` means a valid report with measured visual gaps; only codes outside `0/1` are infrastructure failures. This evidence establishes coverage and current differences, not renderer parity.
|
|
|
|
|
|
|
|
|
|
```powershell
|
|
|
|
|
.\tools\run_render_baseline.ps1 `
|
|
|
|
|
-Output user://render_baseline_m00_final_2026-07-12 `
|
|
|
|
|
-Output user://render_baseline_m00_complete_2026-07-13 `
|
|
|
|
|
-CacheState existing `
|
|
|
|
|
-WaitSeconds 8 `
|
|
|
|
|
-MeasureSeconds 0.5 `
|
|
|
|
|
-ReferenceCheckpointDirectory .\sources\OpenWCReferenceCheckpoints `
|
|
|
|
|
-VisualComparisonReport user://render_baseline_m00_final_2026-07-12/visual_comparison.json `
|
|
|
|
|
-VisualComparisonReport user://render_baseline_m00_complete_2026-07-13/visual_comparison.json `
|
|
|
|
|
-VisualComparisonWidth 2560 `
|
|
|
|
|
-VisualComparisonHeight 1440
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
The initial shell timeout detached the canonical capture process after it started. The process completed all fourteen canonical captures and wrote `report.json`; the documented visual-capture and comparator stages were then invoked separately with the same arguments. The final output directory contains both complete reports.
|
|
|
|
|
|
|
|
|
|
## Paired metrics
|
|
|
|
|
|
|
|
|
|
| Checkpoint | Pass | Mean perceptual error | Changed-pixel ratio | Classification |
|
|
|
|
|
|---|---|---:|---:|---|
|
|
|
|
|
| `elwynn_adt_boundary` | cold | 0.087347 | 0.634984 | Composition plus terrain/vegetation/material gaps |
|
|
|
|
|
| `elwynn_adt_boundary` | cold | 0.087258 | 0.634580 | Composition plus terrain/vegetation/material gaps |
|
|
|
|
|
| `elwynn_adt_boundary` | warm | 0.087255 | 0.634598 | Stable against revisit |
|
|
|
|
|
| `elwynn_terrain_overview` | cold | 0.174136 | 0.851806 | Largest composition/framing gap |
|
|
|
|
|
| `elwynn_terrain_overview` | warm | 0.176952 | 0.861275 | Stable gap, not a cold-load artifact |
|
|
|
|
|
| `elwynn_waterfall_liquid` | cold | 0.088526 | 0.706897 | Framing, terrain, liquid and lighting gaps |
|
|
|
|
|
| `elwynn_waterfall_liquid` | warm | 0.087490 | 0.695281 | Stable against revisit |
|
|
|
|
|
| `goldshire_dense_m2` | cold | 0.066892 | 0.575205 | Smallest available paired gap; vegetation/material differences remain |
|
|
|
|
|
| `goldshire_dense_m2` | warm | 0.066927 | 0.575547 | Stable against revisit |
|
|
|
|
|
| `goldshire_inn_large_wmo` | cold | 0.101230 | 0.701836 | WMO is ready; manual framing and presentation gaps remain |
|
|
|
|
|
| `goldshire_inn_large_wmo` | warm | 0.101203 | 0.701855 | Stable against revisit |
|
|
|
|
|
| `elwynn_sky_dusk` | cold | 0.094778 | 0.575956 | Approximate paired camera; sky color, lighting and scene-composition gaps |
|
|
|
|
|
| `elwynn_sky_dusk` | warm | 0.094757 | 0.575898 | Stable against revisit |
|
|
|
|
|
| `elwynn_terrain_overview` | cold | 0.174137 | 0.851791 | Largest composition/framing gap |
|
|
|
|
|
| `elwynn_terrain_overview` | warm | 0.176955 | 0.861271 | Stable gap, not a cold-load artifact |
|
|
|
|
|
| `elwynn_waterfall_liquid` | cold | 0.088629 | 0.706522 | Framing, terrain, liquid and lighting gaps |
|
|
|
|
|
| `elwynn_waterfall_liquid` | warm | 0.087398 | 0.693690 | Stable against revisit |
|
|
|
|
|
| `goldshire_dense_m2` | cold | 0.066893 | 0.575257 | Smallest available paired gap; vegetation/material differences remain |
|
|
|
|
|
| `goldshire_dense_m2` | warm | 0.066927 | 0.575592 | Stable against revisit |
|
|
|
|
|
| `goldshire_inn_large_wmo` | cold | 0.101224 | 0.701835 | WMO is ready; manual framing and presentation gaps remain |
|
|
|
|
|
| `goldshire_inn_large_wmo` | warm | 0.101206 | 0.701855 | Stable against revisit |
|
|
|
|
|
| `gryphon_roost_native_animation` | cold | 0.119467 | 0.882073 | Same build-12340 asset, different real/synthetic placement and uncontrolled animation phase |
|
|
|
|
|
| `gryphon_roost_native_animation` | warm | 0.119471 | 0.882076 | Full-frame metric is diagnostic only; animation observation is human evidence |
|
|
|
|
|
|
|
|
|
|
Cold and warm values are close for all five references. The paired gaps are therefore not explained by first-visit cache readiness. Goldshire timing evidence separately demonstrated that the 8-second wait is necessary for WMO publication.
|
|
|
|
|
Cold and warm values are close for all seven references. The measured gaps are therefore not explained by first-visit cache readiness. Goldshire timing evidence separately demonstrated that the 8-second wait is necessary for WMO publication.
|
|
|
|
|
|
|
|
|
|
## Animation and sky provenance
|
|
|
|
|
|
|
|
|
|
The private source corpus preserves exact screenshot bytes; no resize, crop or generated content was used:
|
|
|
|
|
|
|
|
|
|
| Evidence | SHA-256 | Interpretation |
|
|
|
|
|
|---|---|---|
|
|
|
|
|
| `elwynn_sky_dusk.jpg` | `1fb06836cacae714c76eaf9b8bf7c292fd5e2f2df33eef821bfe4c4a6bd97072` | Build 12340, Elwynn camera position, server time approximately 19:00, UI hidden |
|
|
|
|
|
| `gryphon_roost_native_animation.jpg` | `d3488c741cb8dfe7212198e48332842631a951862a4388b67045338f37357447` | Build 12340 real-world `GryphonRoost01` placement, first visible wing phase |
|
|
|
|
|
| diagnostic animation phase B | `1025572c7ab9fa0d2e500ff026be46eb9c1e6e5447116dbdc3675dd5f44574ab` | Same camera three seconds later; visibly raised wing phase |
|
|
|
|
|
| diagnostic placement context | `b12c0b713a7d75123ed30f5a316b33537331442cd56615aea69214c7cc4e7a42` | Two real Lakeshire placements and surrounding build-12340 scene |
|
|
|
|
|
|
|
|
|
|
An ADT scan found no `GryphonRoost01` placement in Goldshire. The M00 checkpoint deliberately injects the model there as a synthetic probe. The original-client observation therefore uses two real Lakeshire placements. The three-second pose change establishes `Observed` native animation behavior, but the full-frame comparison cannot establish spatial or animation-phase parity.
|
|
|
|
|
|
|
|
|
|
## Fidelity interpretation
|
|
|
|
|
|
|
|
|
|
M00 now has reproducible quantitative evidence for terrain, ADT boundary, dense M2, large WMO and liquid checkpoints. The reports demonstrate current differences; they do not claim renderer parity. Camera calibration experiments also show that unknown manual yaw/pitch/FOV cannot be recovered reliably from full-frame color error alone. Region scoring reduces terrain bias but still requires semantic landmark approval.
|
|
|
|
|
M00 now has private build 12340 evidence for every required coverage category: terrain, ADT boundary, dense M2, large WMO, liquid, animated M2 and sky transition. The sky reference is approximately paired by map position/time and manually approved composition. Animated-M2 evidence is asset-paired but placement-unpaired because the OpenWC probe is synthetic.
|
|
|
|
|
|
|
|
|
|
Two manifest checkpoints still lack original-client paired references:
|
|
|
|
|
|
|
|
|
|
- `gryphon_roost_native_animation` is a synthetic native-animation probe and has no matching build 12340 fixture.
|
|
|
|
|
- `elwynn_sky_dusk` has no approved build 12340 sky-transition fixture at the same time/weather state.
|
|
|
|
|
|
|
|
|
|
These must either receive private reference evidence or be explicitly accepted by the milestone integrator as unpaired diagnostic coverage. Until that decision, the target remains `ACTIVE`.
|
|
|
|
|
The reports demonstrate current differences and do not claim `1:1`. Camera calibration experiments also show that unknown manual yaw/pitch/FOV cannot be recovered reliably from full-frame color error alone. Region scoring reduces terrain bias but still requires semantic landmark approval.
|
|
|
|
|
|
|
|
|
|
## Operational risks
|
|
|
|
|
|
|
|
|
|
The full GUI capture completed and wrote both reports, but Godot still emitted renderer RID/resource leak diagnostics at exit. The earlier anonymous headless `RefCounted` leak is fixed; GUI renderer allocations are a distinct known risk. They do not invalidate the written images or metrics, but must remain recorded rather than hidden.
|
|
|
|
|
The full GUI visual capture completed and wrote its report, but Godot still emitted renderer RID/resource leak diagnostics at exit, including leaked material, shader, texture, instance and rendering-device RIDs. The earlier anonymous headless `RefCounted` leak is fixed; these GUI renderer allocations are a distinct known risk. They do not invalidate the written images or metrics, but must remain recorded rather than hidden.
|
|
|
|
|
|
|
|
|
|
## Integrator decision checklist
|
|
|
|
|
|
|
|
|
|
- Five available reference checkpoints: paired cold/warm report complete, missing pairs zero.
|
|
|
|
|
- Animated M2 fixture: missing or explicitly accepted as synthetic-only.
|
|
|
|
|
- Sky-transition fixture: missing or explicitly accepted as unpaired.
|
|
|
|
|
- Seven required reference checkpoints: cold/warm report complete, `compared=14`, `missing=0`.
|
|
|
|
|
- Animated M2: build-12340 native motion observed in two phases; synthetic/real placement mismatch explicitly classified.
|
|
|
|
|
- Sky transition: build-12340 19:00 evidence present with approximate paired camera and human-approved composition.
|
|
|
|
|
- Renderer visual differences: registered as gaps, not parity claims.
|
|
|
|
|
- GUI renderer RID/resource diagnostics: accepted as a tracked risk or assigned a follow-up blocker.
|
|
|
|
|
- Target status and `OPENWC_TARGET_DONE` marker: integrator-only action.
|
|
|
|
|
- Target status, target Evidence and `OPENWC_TARGET_DONE` marker: integrator-only actions.
|
|
|
|
|