ReviewOS

zig-utils/zig-js

WebAssembly profiles: publish versioned upstream conformance matrix

#268
Closed chris opened this 9 days ago ·
9 days ago

Parent: #142 Depends on: all selected profile implementation children Related: #147 Children: #319, #320, #321, #366 Roadmap: #134

Provide the auditable completion gate for post-MVP profiles.

Acceptance:

  • Pin exact upstream proposal/spec repositories and commits for every declared profile.
  • Extend the corpus runner/inventory with profile, feature, execution-mode, host, and architecture dimensions.
  • Add bounded CI smoke/drift gates per profile and deliberate complete-run commands.
  • Publish per-profile pass/fail/not-applicable/runner-error totals with reasons and zero hidden filtering.
  • Update README, docs, and #147 compatibility matrix from committed artifacts.

Completion evidence:

  • Ten terminal profiles in docs/.data/wasm-conformance-matrix.json
  • Aggregate: 151,802/151,802 applicable, 2,862 explicit N/A, zero failures/runner errors
  • Exact pins, converters, execution modes, host/architecture scopes, and per-profile totals are machine-readable
  • Bounded exact-pin CI jobs cover MVP, Core 2, SIMD, Threads, tail calls, exceptions, multi-memory, Memory64, GC, and Core 3
  • Complete-run commands are documented in docs/wasm.md
  • Core 3 child #366 is complete with non-blocking upstream-main drift reporting
  • Terminal publication: aa70d874; concise README/docs: bf4ed16f
9 days ago

Structural Core 2 evidence is now available as an exact input to the final profile matrix: 27,437/27,437 applicable commands pass across all 90 pinned wg-2.0 core files, with 581 explicit text-format n/a commands and zero failures/runner errors. Inventory commit 12ce485 records modes and feature-area subtotals; exact pin/drift CI landed in a593fde; README/docs landed in 66a953a. #263/#273 are closed; this issue remains open for the remaining declared profiles.

9 days ago

Integrated the generated nine-profile Wasm artifact into #147 in 54f183f. The release checker derives all 87,838 applicable passes and 1,627 explicit N/A directly from wasm-conformance-matrix.json, verifies the README aggregate, and blocks premature removal of the missing-surface section. The README/docs/#147 acceptance item is now complete; bounded per-profile CI witnesses remain open.

9 days ago

The final per-profile CI gate is now on main in 9226876a.

Two exact-pin jobs add representative runtime drift coverage for all remaining terminal profiles:

  • 208 WABT-backed commands across tail calls, exception handling, and multi-memory;
  • 391 wasm-tools-backed commands across Memory64 and GC.

The feature-profile checker now locks both job names, all five proposal revisions, the official wasm-tools 1.253.0 Linux archive digest, and all profile invocations. docs/wasm.md records the bounded/complete-run boundary and the missing full GC reproduction command. Local registry, nine-profile matrix, YAML, and documentation checks are green. Descendant matrix: https://github.com/zig-utils/zig-js/actions/runs/29708347319

9 days ago

Added #366 for the missing stable Core 3 baseline. The existing wasm-spec submodule remains the exact wg-1.0 MVP fixture; #366 adds wg-3.0 as a separately named/profiled inventory and treats moving upstream main as drift evidence rather than a publishable score. This preserves reproducibility while closing the misleading “generic submodule means current spec” gap.

9 days ago

Completed. The generated ten-profile matrix and release input are terminal green, every declared profile has bounded exact-pin CI plus a deliberate full-run path, and Core 3/upstream drift are now integrated without changing frozen baselines.

Sign in to comment on this issue.