ReviewOS

home-lang/home

Track TypeScript frontend benchmark leadership

#416
Open chris opened this 23 days ago · 283 comments
23 days ago

Goal

Maintain a fair, reproducible TypeScript frontend performance suite and improve Home until it leads JavaScript tsc 6 and stable native TypeScript 7 across every accepted workload.

Benchmark rules

  • All compilers receive identical valid source graphs and compiler options.
  • Every compiler must validate successfully and silently before timing, and reject the same invalid controls with the expected diagnostics.
  • All selected workloads must pass admission before any timing or result-directory creation; no failing row is silently omitted.
  • Compiler versions and generated workloads are pinned.
  • JavaScript TypeScript 6 and native TypeScript 7 are installed in isolated prefixes.
  • Measurements rotate compiler order within every round to balance workstation load.
  • Workloads represent general compiler behavior, never benchmark-specific shortcuts.
  • Results, environment details, caveats, and reproduction commands stay documented.

Landed foundation

  • Nineteen deterministic workloads covering startup, files, complex types, module graphs, TSX, inference, control flow, predicates at two scales, null-safe access, destructuring, overloads, classes, structural objects, interface composition, variadic tuples, checked JavaScript, and recursive generic consumers
  • Pinned JavaScript tsc 6.0.3 and stable native TypeScript 7.0.2 toolchain
  • Interleaved Hyperfine measurement schedule and silent-success validity gate
  • Release allocator, reusable source I/O, and bounded large-program parallelism
  • Cached source facts, bind-only export analyses, and projected export-name sets
  • Indexed lexical declarations, interface merge predecessors, namespaces, annotations, and validated type display names
  • Pruned provably irrelevant overload, inference, import, expando, and compatibility work
  • Relation-cache working-set retention and single-probe insertion
  • Full performance documentation and linked README summary

Current correctness and measured status

Implementation 1cfc33c (#536), audit d95dfaa (#541), and verified README/report 707045c are pushed to main as Chris with no coauthors. TS 6.0.3 and native TS 7.0.2 are verified; TS7/tsgo is one competitor.

The prepared-owner CommonJS display query removes the extra full source compilation and raw-text recovery. Program140/140, conformance1418/1418, CLI69/69 and harness75/75 pass; unchanged checker/driver targets verify from cache. All19 unchanged admission gates and all15 complete audit case sets preserve every previously passing case. Disk-interrupted logs remain alongside complete retries; no partial audit was accepted.

Same-correctness 30-round alternating comparison: import graph32.4±1.7ms to28.4±0.6ms, 12.4% less time and30/30 paired wins. Barrel27.9±5.2ms to27.3±4.2ms, only2.3% lower with17/30 paired wins: inconclusive, not a reliable improvement. All60 rounds/120 successful samples retained.

Full measurement20260828T234350Z validates570 rounds/1710 successful finite samples, with all513 input files byte-for-byte unchanged. Home has lower means on19/19: import graph28.1ms vs TS7 47.0ms (1.67x), barrel25.6ms vs42.7ms (1.67x), large predicates340.5±18.2ms vs362.2±30.4ms (1.06x;29/30 paired wins). Several rows have substantial shared-host variance. Independent confirmation20260828T234818Z retains30 rounds/90 samples: large predicates Home358.6±11.7ms vs TS7 388.5±16.7ms (1.08x;30/30 paired wins). It is separate, not substituted or pooled. Selected compiler/native-payload/runtime/launcher paths and hashes match before and after both measurements; automated harness provenance is tracked by#544.

CommonJS instance typing is NOT admitted for timing: TS6/TS7 pass66/66, Home22/66, with all44 missing wrong-type/missing-member rejections retained under#541. Export-list controls remain80/96 (#540). Other remaining gaps include owners12/20, nominal origins44/52, globals32/56 and bound globals44/56. The broader goal stays open: real projects, additional rejection coverage, other platforms and semantic correctness remain unproven. Next priorities are actual source-owned CommonJS require types#541 and precise external hidden-binding diagnostics#540.

Frozen candidate commonjs-query.hyU20d/release-v1/bin/home-tsc, SHA-256573257a819a178c9387f6d02a7992c08f995185f5dbc94034eb5eadc0ae956c0. Full results, retained history and reproduction.

Historical indexed-export checkpoint

Implementation b7b9dd9 (#537) and parser ownership fix d6878e8 (#538), with verified README/report 24a34f4, are pushed to main. Compiler versions are verified TS 6.0.3 and native TS 7.0.2; TS 7/tsgo is one competitor.

All 19/19 unchanged workload admission gates pass. Full measurement 20260828T231439Z validates 570 rounds / 1,710 successful finite samples; fresh generation matches 513 measured input files. Home has lower means on 19/19 workloads, but large predicates have only a noisy 1.02x lead: 371.6 ± 125.5 ms versus TS 7 377.7 ± 66.4 ms, 25/30 paired wins. Independent 30-round confirmation 20260828T231856Z retains all 90 samples: Home 320.4 ± 2.8 ms versus TS 7 331.4 ± 4.6 ms (1.03x; 29/30 paired wins). Confirmation is separate, not substituted into the full table.

The same-correctness alternating before/after comparison for #537 improves 525.6 ± 12.4 ms to 353.5 ± 10.5 ms, 32.7% less time and 30/30 paired wins. Deterministic source visits drop 65,536 to 256 for 128 independent exports. Bound-owner edge indexing preserves semantic query work; no control or failed observation was removed.

New exported-variable-list audit improves 0/96 to 80/96. All 32 positives, 32 wrong-type controls and 16 barrel hidden-name controls pass; 16 direct-hidden diagnostics remain TS2305 instead of TS2459 (#540). Existing audit scores remain: factory 240/240, recursive 288/288, generic classes 120/120, static 84/84, bound classes 52/52, callable identity 56/56, callable unions 256/256, graph discovery 28/28, export origins 32/32, owners 12/20, nominal origins 44/52, globals 32/56, bound globals 44/56. Both competitors pass every audit.

Verified suites: checker 4286, conformance 1417, Program 137, parser 891, driver 187, CLI 69, emitter 499 and benchmark harness 72 tests all pass. Pickier reports no errors and one pre-existing README fragment warning. Frozen evidence export-index.NVcIdu, SHA-256 615e9fa1f78c2cad17a0b8911b897ede73c00422138d6ecbb2b74801d4564f14.

Next: #536 removes redundant CommonJS export-query compilation; #540 adds external owner-local diagnostic facts. Correctness gaps, expanded rejection coverage, real projects and cross-platform measurements keep the overall goal open. Shared-host synthetic results are not universal benchmark leadership. Full results and reproduction.

Historical exported-factory checkpoint

Implementation de8fe28 (#534), documentation/README f3740df. Executables are verified TS 6.0.3 and native TS 7.0.2; native TS7/tsgo is one competitor.

All 19/19 workload admission gates now pass for all three compilers. Both original graph projects and their unchanged TS2322/TS2339 rejection controls pass; no failing workload was removed. The 240 exported-factory controls improve from Home130/240 to240/240. Recursive288/288, generic classes120/120, static84/84, bound classes52/52, callable identity56/56, callable unions256/256, graph discovery28/28 and export origins32/32 remain passing. Imported owners improve10/20 to12/20; nominal origins44/52, globals32/56 and bound globals44/56 remain incomplete. Both competitors pass all these audit cases.

Full relevant suites: checker4286/4286, conformance1417/1417, Program133/133, driver187/187, CLI69/69, source-owned focus10/10, harness69/69.

Complete measurement 20260828T224220Z: 30 interleaved rounds after3 warmups, all570 round files /1710 samples validate; fresh generation matches all513 measured input files. Shared Apple M3 Pro workstation with unrelated CPU/filesystem activity. Home has lower means on 18/19 workloads, not universal leadership. Import graph33.7ms vs TS7 50.8ms (1.51x); barrel graph25.1ms vs41.1ms (1.63x). Large predicates lose: Home541.3 ±50.7ms vs TS7 380.6 ±44.8ms, 1.42x slower and0/30 paired wins. That losing row is retained in README and full docs.

Next: #537 establishes and fixes the large-predicate scaling cause against a same-correctness controlled baseline; #536 removes redundant CommonJS export-query compilation. Remaining semantic failures, broader rejection coverage, real-project and cross-platform measurements keep the overall goal open. Frozen evidence: graph-types.4EsbvV; binary SHA256 9f5e333beaf9828a9720ce260ae05a872ebcea3bb51bf5785ffa3ccd7b72f1bc. Documentation: docs/docs/TS_PERFORMANCE.md#exported-factory-checkpoint-performance.

Historical checkpoint before exported-factory typing

Checkpoint: implementation 3b7f0ea (#524), recursive throughput workload de72563, report-integrity fix 74d1163, and documentation/README 91d6ca8. Pinned executables are TS 6.0.3 and native TS 7.0.2; TS 7 and tsgo are one competitor.

The original admission set remains 16/18 for Home: both imported graph rejection gates fail and were not timed. The added recursive workload passes its positive and nine appended negative controls, making expanded admission 17/19 (both competitors 19/19). No failure is removed by expanding the denominator.

Untimed correctness gateTS 6.0.3Native TS 7.0.2Home
Global declarations56/5656/5632/56
Bound-global discovery56/5656/5644/56
Imported owners20/2020/2010/20
Nominal identity52/5252/5244/52
Imported generic classes120/120120/120120/120
Recursive generic consumers288/288288/288288/288
Import/re-export graph admission2/22/20/2

Lazy source-owned definitions improve recursive controls from 112/288 to 288/288 and imported generic classes from 118/120 to 120/120. Local non-exported classes remain non-exported; transparent aliases preserve their target's origin. No fixed-depth unfolding or new permissive fallback. Inheritance, global/owner typing, broader generic forms and original graph linkage remain open (#521, #480, #487).

Fresh full timing 20260828T221149Z has lower Home means on 17/17 admitted timed workloads, with 510 complete round files and 1,530 successful samples. Apple M3 Pro, 30 interleaved runs after three warmups, shared-workstation load. Recursive generics: Home 29.7 ± 0.2 ms, native TS 7 71.8 ± 1.1 ms, TS 6 151.7 ± 2.2 ms (2.42× lower mean). Large predicates: Home 377.0 ± 100.9 ms, native TS 7 393.6 ± 94.1 ms (1.04× lower mean; noisy). Other rows also have substantial variance.

Independent confirmation 20260828T221611Z retains 60 complete rounds / 180 successful samples. Recursive generics: Home 29.6 ± 0.7 ms vs native 73.1 ± 3.9 ms (2.47×; Home faster in 30/30 paired rounds). Large predicates: Home 349.9 ± 17.0 ms vs native 392.7 ± 83.0 ms (1.12×; 28/30 paired rounds). Confirmation does not replace or get averaged into the full run. The predecessor fails recursive rejection controls and is ineligible for a before/after timing claim.

Exact-source tests: checker 4285/4285, conformance 1417/1417, Program 131/131, driver 187/187, CLI 69/69, focused source-owned 9/9, harness 66/66. Release SHA-256: 267691e33056e2c4a8b23b757bc3eed19c8b3d90fa9407120b8985834a844ccd. Reporting now rejects incomplete/extra rounds, incorrect compiler coverage/order, malformed JSON, and failed/invalid samples instead of publishing partial averages.

Full results, variance, preserved history and reproduction. Correctness details.

Not complete: these are local synthetic observations under shared-host load, not universal, real-project or cross-platform leadership. The two original graph gates and broader semantic coverage still fail or remain unverified. The tracker stays open.

Historical measured snapshot (not current admission)

Apple M3 Pro, 30 interleaved runs after three warmups; raw full-suite result 20260827T202656Z, compiler commit 9e45e10, documentation commit 75e02f3. Every observation is retained, including variance and outliers.

Workloadtsc 6.0.3native TS 7.0.2Home 0.1.0Home vs fastest competitor
startup64.4 ± 1.8 ms42.2 ± 11.3 ms3.9 ± 2.7 ms10.82× faster
many_files213.2 ± 14.8 ms53.5 ± 3.1 ms30.0 ± 1.5 ms1.78× faster
deep_types127.9 ± 2.2 ms52.6 ± 1.5 ms12.9 ± 0.3 ms4.09× faster
import_graph129.2 ± 1.9 ms45.0 ± 0.9 ms25.8 ± 1.1 msIneligible: fails semantic controls
reexport_graph94.7 ± 3.0 ms40.7 ± 0.9 ms26.8 ± 0.6 msIneligible: fails semantic controls
tsx_components159.1 ± 1.2 ms46.3 ± 0.9 ms21.3 ± 0.3 ms2.17× faster
generic_calls177.5 ± 4.4 ms55.4 ± 11.2 ms22.0 ± 1.8 ms2.52× faster
control_flow212.2 ± 127.9 ms63.1 ± 22.3 ms32.9 ± 3.8 ms1.92× faster
type_predicates237.3 ± 14.0 ms72.4 ± 10.8 ms46.5 ± 19.5 ms1.56× faster
type_predicates_large1027.8 ± 117.6 ms348.8 ± 15.7 ms322.1 ± 13.3 ms1.08× faster
null_safe_access206.3 ± 12.4 ms60.3 ± 2.4 ms40.6 ± 1.8 ms1.49× faster
destructuring144.3 ± 11.1 ms48.5 ± 1.1 ms35.3 ± 0.8 ms1.38× faster
overload_resolution222.7 ± 20.6 ms71.6 ± 10.7 ms30.9 ± 2.9 ms2.32× faster
class_hierarchy200.0 ± 17.6 ms55.8 ± 4.5 ms29.8 ± 1.1 ms1.87× faster
structural_objects197.7 ± 9.7 ms60.7 ± 2.8 ms31.5 ± 1.1 ms1.93× faster
interface_composition233.3 ± 43.6 ms76.2 ± 30.3 ms46.5 ± 3.4 ms1.64× faster
variadic_tuples268.4 ± 33.0 ms81.0 ± 8.5 ms46.2 ± 8.3 msProvisional: older admission schema
checkjs_jsdoc246.4 ± 48.7 ms63.0 ± 16.6 ms41.2 ± 6.8 ms1.53× faster

Historical snapshot: 18/18 lower Home means were recorded, with stronger primitive-return checking. This is not current acceptance: the two graph claims were subsequently withdrawn and later compiler changes have not been retimed. Large predicates have a 1.08× mean lead. The predeclared independent 30-round confirmation 20260827T203044Z records Home 342.5 ± 29.3 ms vs native TS 7 370.2 ± 22.0 ms (1.08× lead); TS 6 is 1086.3 ± 96.2 ms. Home is faster than native in 29/30 paired large-case rounds in the full run and 26/30 in the confirmation. The confirmation does not replace or get averaged into the full table. All 1,710 timed samples succeeded; exact versions, balanced ordering, published tables, preserved binary, and frozen predicate hashes were verified.

All 99 program, 4,226 checker, 173 driver, and 16 harness/report tests pass, as do all 18 shared positive projects and 13 negative controls per compiler. Five new return-contract regression groups have been independently checked with the same CLI inputs against both TS baselines (#474). Async is not an accepted workload: #475 and #476 still fail semantic controls, and #478 tracks diagnostic wording. Do not infer full TypeScript parity from these counts.

These are local synthetic results, not proof of universal, real-project, or cross-platform leadership. Several rows have substantial variance; no observations were discarded. The correctness fix is not itself claimed as a performance optimization. Full methods, history, and reproduction.

Previous 18-workload snapshot (retained)

Previous measured snapshot

Apple M3 Pro, 30 interleaved runs after three warmups; raw full-suite result 20260827T195539Z, compiler commit d330198, documentation commit 20084a4. Every observation is retained, including variance and outliers.

Workloadtsc 6.0.3native TS 7.0.2Home 0.1.0Home result
startup66.7 ± 2.5 ms42.0 ± 9.6 ms3.6 ± 0.4 ms11.73× faster
many_files215.4 ± 3.3 ms56.7 ± 7.5 ms32.4 ± 6.3 ms1.75× faster
deep_types146.0 ± 8.6 ms58.3 ± 3.7 ms14.1 ± 0.8 ms4.12× faster
import_graph139.0 ± 4.4 ms49.8 ± 4.1 ms29.3 ± 2.0 ms1.70× faster
reexport_graph111.0 ± 46.4 ms47.0 ± 19.2 ms31.1 ± 6.1 ms1.51× faster
tsx_components178.0 ± 25.2 ms50.2 ± 1.6 ms23.3 ± 4.1 ms2.16× faster
generic_calls188.4 ± 12.9 ms57.3 ± 3.9 ms23.2 ± 2.0 ms2.47× faster
control_flow190.2 ± 4.8 ms59.5 ± 2.2 ms33.6 ± 5.4 ms1.77× faster
type_predicates237.8 ± 12.7 ms70.9 ± 2.0 ms41.9 ± 0.8 ms1.69× faster
type_predicates_large1010.4 ± 25.3 ms351.4 ± 15.2 ms323.8 ± 10.2 ms1.09× faster
null_safe_access191.9 ± 4.1 ms57.2 ± 1.1 ms38.7 ± 0.5 ms1.48× faster
destructuring138.4 ± 1.6 ms47.3 ± 1.0 ms34.4 ± 0.5 ms1.37× faster
overload_resolution203.1 ± 3.4 ms64.6 ± 1.4 ms29.1 ± 0.6 ms2.22× faster
class_hierarchy186.1 ± 7.9 ms53.4 ± 7.8 ms28.1 ± 0.4 ms1.90× faster
structural_objects185.8 ± 2.9 ms58.1 ± 1.6 ms30.3 ± 0.6 ms1.92× faster
interface_composition214.9 ± 41.7 ms64.7 ± 4.3 ms45.6 ± 6.0 ms1.42× faster
variadic_tuples252.9 ± 6.3 ms77.7 ± 2.5 ms42.4 ± 1.0 ms1.83× faster
checkjs_jsdoc211.5 ± 27.6 ms54.3 ± 1.2 ms36.9 ± 0.9 ms1.47× faster

Then-reported snapshot: 18/18 lower Home means; retained as history, not current admission or a restored graph speed claim. Large predicates have a 1.09× mean lead. The predeclared independent 30-round confirmation 20260827T200026Z records Home 327.1 ± 10.4 ms vs native TS 7 359.7 ± 14.2 ms (1.10× lead). The confirmation does not replace or get averaged into the full table. All 1,710 timed samples succeeded; exact versions, balanced ordering, both tables, and frozen predicate hashes were verified. All 99 program, 4,221 checker, 173 driver, and 16 harness/report tests pass, as do all shared positive projects and negative controls.

These are local synthetic results, not proof of universal, real-project, or cross-platform leadership. Full methods, retained history, and reproduction: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md

Earlier 13-workload snapshot (retained)

Earlier snapshot

Apple M3 Pro, 30 interleaved runs after three warmups, mean wall time; raw result ID 20260827T085121Z. Background workstation activity increased absolute time and variance; the report retains every sample and rotates compiler order.

Workloadtsc 6.0.3native TS 7.0.2Home 0.1.0Home result
startup109.0 ms60.2 ms6.7 ms8.99× faster
many_files426.6 ms93.6 ms54.1 ms1.73× faster
deep_types260.0 ms90.3 ms28.9 ms3.12× faster
import_graph260.0 ms79.3 ms48.2 ms1.65× faster
reexport_graph195.6 ms72.6 ms57.9 ms1.25× faster
tsx_components364.1 ms90.5 ms44.5 ms2.03× faster
generic_calls360.5 ms93.8 ms51.7 ms1.81× faster
control_flow392.2 ms100.3 ms77.1 ms1.30× faster
overload_resolution491.2 ms132.3 ms88.5 ms1.49× faster
class_hierarchy406.5 ms96.0 ms83.7 ms1.15× faster
structural_objects361.8 ms102.3 ms69.4 ms1.47× faster
interface_composition532.6 ms133.1 ms122.8 ms1.08× faster
variadic_tuples634.1 ms160.8 ms153.5 ms1.05× faster

Then-accepted suite: 13/13 lower Home means.

Next coverage

  • Preserve actual global declaration types, merging and lexical isolation across files (#480)

  • Preserve generic imported/re-exported types and owner metadata, including source-order/cycle handling; readmit graph timing only after the unchanged controls pass (#487)

  • Add shared async/await and Promise type-propagation coverage with negative controls (#473; remaining #475, #476, #478)

  • Validate the legacy container path before claiming cross-platform results (#464)

  • Resolve independently tracked semantic/source-lifetime gaps (#467, #472)

  • Add a fair emit workload when output semantics are validated across all compilers

  • Add pinned real-world projects only where all compilers accept the same graph and configuration

  • Profile and resolve every regression or loss introduced by accepted workloads

  • Keep README and detailed performance documentation synchronized

Commit links and before/after measurements are maintained in the issue comments. The tracker remains open while coverage expands.

23 days ago

Foundation commit links:

All future performance commits will reference #416 directly in the commit body. The issue remains open while coverage expands.

23 days ago

New accepted workload landed in https://github.com/home-lang/home/commit/355c1f5d4.

Baseline from 10 interleaved runs after three warmups:

WorkloadtsctsgoHomeHome vs fastest
import_graph57.5 ± 12.1 ms53.6 ± 1.9 ms421.6 ± 24.1 ms7.86x slower

All three compilers validated the identical 128-module relative-import chain successfully and silently. This is now the active profiling target. The workload covers module resolution, export lookup, import closure, and cross-file generic checking.

23 days ago

Import-graph optimization landed in two issue-linked commits:

Verified with complete ts_driver, ts_program, and ts_cli test targets plus Debug and ReleaseFast home-tsc builds.

Post-fix result from 10 interleaved runs after three warmups:

WorkloadtsctsgoHomeHome vs fastest
import_graph51.1 ± 2.0 ms52.1 ± 3.9 ms31.4 ± 2.2 ms1.63x faster

The accepted suite is now 4/4 Home wins. Next: publish the expanded 30-run snapshot and keep broadening coverage.

23 days ago

The 30-run expanded snapshot is published in https://github.com/home-lang/home/commit/469deeb1d and linked from the README.

Final interleaved results after five warmups:

WorkloadtsctsgoHomeHome vs fastest
startup41.0 ± 11.4 ms39.4 ± 3.1 ms3.5 ± 0.1 ms11.24x faster
many_files55.2 ± 1.4 ms55.0 ± 1.6 ms33.7 ± 0.9 ms1.63x faster
deep_types54.8 ± 2.7 ms54.5 ± 1.4 ms46.0 ± 0.9 ms1.18x faster
import_graph47.4 ± 2.3 ms47.7 ± 3.1 ms27.6 ± 2.1 ms1.72x faster

Current accepted suite: 4/4 Home wins. The tracker remains open for the next fair workload.

23 days ago

Barrel re-export coverage is landed and documented.

Commits:

  • a7fa412 — fix false TS2308 collisions by comparing real projected export names (Fixes #417)
  • 4cc8f42 — add the unchanged 64-leaf / 8-barrel workload
  • af26e79 — publish the 30-run results in the detailed docs and README

Verification:

  • full ts_checker and ts_program suites pass
  • ReleaseFast home-tsc builds
  • every compiler validates the same corpus silently
  • an injected collision produces the same TS2308 diagnostics as tsc

30 interleaved runs after three warmups:

WorkloadtsctsgoHomeHome vs fastest
startup59.4 ± 21.9 ms56.9 ± 11.1 ms4.7 ± 0.7 ms12.08x faster
many_files89.3 ± 25.8 ms88.0 ± 26.2 ms52.7 ± 17.1 ms1.67x faster
deep_types89.0 ± 24.5 ms78.2 ± 14.8 ms57.3 ± 8.1 ms1.36x faster
import_graph62.6 ± 8.5 ms63.5 ± 8.7 ms38.2 ± 5.4 ms1.64x faster
reexport_graph56.6 ± 8.4 ms58.8 ± 8.1 ms48.1 ± 8.4 ms1.18x faster

Current accepted suite: 5/5 Home wins. The tracker remains open for the next fair workload.

23 days ago

Typed TSX coverage is landed, optimized, and documented without changing the accepted workload during tuning.

Commits:

  • a08199b — cache immutable JSX/source facts and build the recovered parameter-annotation index in one source pass
  • e83cca9 — add the deterministic 256-component typed TSX workload
  • ac1f7e9 — publish the 30-run results in the detailed docs and linked README table

The unchanged workload initially measured 76.4 ± 0.5 ms in Home versus 55.2 ± 1.0 ms in tsgo over five runs. Profiling identified repeated whole-source compatibility probes; the general per-source caches and index reduced Home to 53.0 ± 1.3 ms in the five-run verification sample.

Verification:

  • full ts_checker suite passes
  • ReleaseFast home-tsc builds
  • all three compilers validate the identical TSX corpus successfully and silently
  • Python generator compilation and targeted Pickier checks pass

Final 30 interleaved runs after three warmups:

WorkloadtsctsgoHomeHome vs fastest
startup49.7 ± 5.9 ms49.1 ± 5.1 ms4.7 ± 1.2 ms10.35x faster
many_files74.4 ± 9.7 ms73.5 ± 8.1 ms46.1 ± 8.1 ms1.59x faster
deep_types66.7 ± 4.5 ms68.3 ± 11.9 ms51.5 ± 5.6 ms1.29x faster
import_graph57.5 ± 3.4 ms58.3 ± 4.4 ms35.9 ± 4.6 ms1.60x faster
reexport_graph58.8 ± 9.3 ms59.5 ± 11.3 ms45.5 ± 5.4 ms1.29x faster
tsx_components55.9 ± 4.2 ms58.8 ± 11.7 ms53.5 ± 1.6 ms1.04x faster

Current accepted suite: 6/6 Home wins. The tracker remains open for the next fair workload.

23 days ago

Added and pushed the compiler-neutral generic_calls benchmark in 0d36ce4. All three pinned compilers accept the unchanged generated project with zero diagnostics.

Initial ReleaseFast smoke timing (1 run, diagnostic only): tsc 55.2 ms, tsgo 54.9 ms, Home 76.5 ms. This is intentionally a red benchmark checkpoint; profiling and general inference-path optimization are next. The correctness prerequisite was fixed in e34242b / #418.

23 days ago

Correction pushed in e278e62: the benchmark now compares JavaScript tsc 6.0.3 with native tsgo 7.0.0-dev.20260707.2. The previous typescript@7.0.2 package launches the TypeScript 7 native compiler family, so treating it as the JavaScript baseline duplicated the tsgo comparison and its earlier timing should be disregarded.

The corrected toolchain validates the same unchanged projects silently. In the first corrected 5-run diagnostic sample, Home still won six workloads; generic_calls remained the sole loss versus native tsgo, so optimization continues there.

23 days ago

Final competitor pin correction pushed in 69d3f9e: JavaScript TypeScript 6.0.3 and stable native TypeScript 7.0.2 are installed in isolated prefixes, so npm cannot replace one compiler with the other. The old @typescript/native-preview dev build is no longer used.

Verified versions: Version 6.0.3 and Version 7.0.2. On this host TS7’s official CLI execves the packaged native arm64 binary. A corrected 5-run sample has Home winning all seven workloads; the narrow generic-call result is Home 62.2 ms vs native TS7 64.3 ms. Full checker verification and a 30-run publication snapshot are still pending.

23 days ago

Generic-call inference benchmark round complete.

Landed:

  • e34242be4 fixed inferred tuple-key mapped returns and concrete primitive template substitutions (#418).
  • 0d36ce480 added the unchanged, compiler-neutral generic_calls workload.
  • 69d3f9e84 pinned stable native TypeScript 7.0.2 in an isolated tool prefix beside JavaScript tsc 6.0.3.
  • b509aa125 skipped irrelevant evolving-any and non-callable identifier scans; all 4,190 checker tests pass.
  • 6cddd926d published the detailed snapshot and README summary.

Corrected publication measurement: Apple M3 Pro, arm64 macOS 27.0, 30 interleaved runs after 3 warmups. Every compiler validated every unchanged project successfully and silently before timing. generic_calls: tsc 250.4 ± 19.1 ms, native TS7 71.4 ± 2.6 ms, Home 68.6 ± 2.3 ms — Home is 1.04x faster. Home wins the full accepted suite, 7/7.

The issue remains open for the next fair emit and real-world coverage additions.

23 days ago

Started the next accepted benchmark round in 89ac313c4: control_flow generates one dependency-free module with 256 exhaustive discriminated-union functions, each exercising switch narrowing, branch joins, definite assignment, nested property reads, and a never exhaustiveness check.

All three pinned compilers accept the exact project successfully and silently. Initial 5-run diagnostic baseline: tsc 6.0.3 = 281.9 ± 52.8 ms, native TS 7.0.2 = 81.5 ± 21.8 ms, Home = 2927.8 ± 159.6 ms. Home is 35.93x slower. The workload is now preserved unchanged while the general scaling defect is profiled and fixed.

23 days ago

Control-flow coverage is green and documented.

Final 30-run result (20260826T221047Z): Home 55.5 ± 11.3 ms, native TS 7.0.2 62.7 ± 16.1 ms, tsc 6.0.3 203.8 ± 73.2 ms. Home is 1.13x faster than the fastest competitor on the unchanged workload, moving the accepted suite to 8/8 wins.

23 days ago

Overload-resolution workload completed and the accepted suite is now 9/9 Home wins.

  • Workload first: be6e9da86 (bench(ts): add overload resolution workload)
  • General checker optimization: 9c6a93b3f (perf(ts-checker): prune overload resolution work)
  • Published README/docs snapshot: a8d16bc09 (docs(ts): publish overload benchmark win)
  • Red five-run baseline (20260826T221712Z): Home 126.9 ± 0.9 ms, native TS 7.0.2 70.3 ± 1.1 ms
  • Final 30-run result (20260826T231722Z): Home 58.1 ± 2.2 ms, native TS 7.0.2 66.4 ± 3.7 ms, tsc 6.0.3 207.2 ± 10.5 ms — Home wins by 1.14×
  • Validation: all compilers accept the unchanged workload silently; 4,190/4,190 checker tests pass; all nine workloads win in the final suite.

Tracker remains open for the next fair coverage addition.

23 days ago

Class-hierarchy benchmark completed and published.

  • workload: b493ea55b
  • optimized checker implementation: 71833644d
  • documentation: df67841bd
  • full checker validation: 4,190/4,190 passed
  • red five-run baseline: Home 79.4 ± 2.8 ms, native TS 7.0.2 59.6 ± 1.5 ms
  • authoritative result 20260826T234231Z: Home 50.7 ± 15.9 ms, native TS 7.0.2 53.6 ± 9.8 ms, tsc 6.0.3 194.1 ± 57.8 ms
  • outcome: Home 1.06× faster than the fastest competitor; accepted suite is now 10/10 Home wins

The workload remained byte-for-byte unchanged after its pre-optimization commit. Detailed results and the README summary are synchronized on main.

23 days ago

Structural-object compatibility benchmark completed and published.

  • frozen workload: 3946ef904
  • optimized checker implementation: 617d29ead
  • documentation: 61e38efa3
  • full checker validation: 4,190/4,190 passed
  • red five-run baseline: Home 160.9 ± 4.5 ms, native TS 7.0.2 62.7 ± 2.7 ms
  • authoritative result 20260827T000322Z: Home 47.5 ± 0.8 ms, native TS 7.0.2 57.0 ± 1.1 ms, tsc 6.0.3 180.6 ± 2.5 ms
  • outcome: Home 1.20× faster than the fastest competitor and 3.39× faster than its frozen baseline; accepted suite is now 11/11 Home wins

The workload remained byte-for-byte unchanged after its pre-optimization commit. Detailed results and the README summary are synchronized on main.

23 days ago

Interface-composition benchmark completed and published.

  • frozen workload: 788192d
  • source: 5,760 lines, 194,012 bytes, SHA-256 84123a04d7d9e3adeb8e1089f068be7524890cbd6872466b83ba2bced0c322be
  • named-type reverse index: 026ab0e
  • interface/namespace/source lookup indexes: ca0b8df
  • README and detailed report: d5076fa
  • full checker validation: 4,190/4,190 passed
  • red five-run baseline 20260827T000848Z: Home 117.3 ± 3.0 ms, native TS 7.0.2 65.3 ± 0.8 ms
  • authoritative 30-run result 20260827T014124Z: Home 74.6 ± 3.0 ms, native TS 7.0.2 82.0 ± 2.3 ms, tsc 6.0.3 294.9 ± 33.5 ms
  • outcome: Home is 1.10× faster than the fastest competitor and 1.57× faster than its frozen baseline; the accepted suite is now 12/12 Home wins

The generated source and compiler options remained unchanged after the workload commit. Every compiler validated every workload successfully and silently before timing; compiler order rotated within every measured round.

23 days ago

Variadic-tuple coverage is landed, optimized, and published; the accepted suite is now 13/13 Home wins by mean time.

The workload stayed byte-for-byte frozen after its benchmark commit (SHA-256 78105a6b28024f5ac1dd32cc81d3aa065a3a99a1972927e1880f0a28eec5324f). The red baseline was Home 209.4 ± 4.8 ms versus native TS 7.0.2 at 100.7 ± 3.3 ms. The authoritative 30-run result 20260827T085121Z is Home 153.5 ± 13.9 ms, native TS 7.0.2 160.8 ± 14.0 ms, and tsc 6.0.3 634.1 ± 72.1 ms: Home records a 1.05× lower mean than the fastest competitor and a 1.36× improvement from its frozen baseline.

All three compilers validate every identical project silently. The report retains all samples, rotates compiler order, and discloses elevated background workstation variance. Full checker validation passes 4,191/4,191 and ReleaseFast builds successfully. The tracker remains open for the next fair workload.

23 days ago

Checked-JavaScript/JSDoc coverage is now merged in fb72502 and documented in 2fafb98. The harness is pinned to JavaScript TypeScript 6.0.3 versus native TypeScript 7.0.2 (the installed benchmark executable also reports Version 7.0.2). In the authoritative interleaved 30-run snapshot 20260827T132029Z, Home wins checkjs_jsdoc at 68.4 ± 4.7 ms versus 76.0 ± 5.5 ms for native TS 7.0.2 and 322.2 ± 40.9 ms for tsc 6.0.3. Home now has the lower mean in all 14 accepted workloads. Issue #448 is complete; this broader tracker stays open for additional fair semantic coverage and optimization.

23 days ago

Milestone update: type-predicate narrowing coverage is landed and #450 is closed.

Commits on main:

  • 9fab1ff — fair deterministic type-predicate/assertion workload
  • 12cbc5b — general checker lookup/index improvements
  • c185044 — README and detailed result publication

Authoritative snapshot 20260827T151143Z uses 30 round-robin interleaved runs after 3 warmups, comparing JavaScript tsc 6.0.3 with native TypeScript/tsgo 7.0.2 and Home 0.1.0. Home wins all 15 workloads. The new type_predicates case is the closest: 69.0 ± 4.9 ms vs tsgo 69.6 ± 5.5 ms (1.01×). Full results and methodology are in docs/docs/TS_PERFORMANCE.md.

Leaving this tracker open for the next fair workload expansion and optimization cycle.

23 days ago

Null-safe-access milestone #451 is landed and documented in ad94381, with general compiler optimization fa78423. The frozen workload improves from 1166.8 ms to 51.1 ms (22.83×), beating native TS 7.0.2 at 71.3 ms in the full 30-run snapshot 20260827T154256Z. The complete checker gate passes 4,192 cases.

Current full-suite result: 15/16 Home mean wins. Checked JavaScript records 58.4 ± 33.3 ms versus tsgo 56.5 ± 2.7 ms, including one 234.3 ms Home sample. That result is retained in README and docs/docs/TS_PERFORMANCE.md; it has not been discarded or replaced by a favorable run. New issue #452 tracks strengthening that margin through general compiler improvements.

23 days ago

Benchmark-leadership update: #452 is resolved by general function-containment indexing in 332e228, with published results in bc3eeaf.

Authoritative snapshot 20260827T155812Z uses 30 round-robin interleaved runs after 3 warmups and records 16/16 Home mean wins against JavaScript tsc 6.0.3 and native TypeScript/tsgo 7.0.2. Checked JavaScript is now 40.1 ± 0.9 ms vs tsgo 51.7 ± 1.1 ms (1.29×). The complete checker gate passes 4,193 cases. The preceding 15/16 snapshot and its JSDoc outlier remain explicitly documented, and the corpus hashes are unchanged.

Leaving this tracker open for continued fair benchmark coverage and performance work.

23 days ago

Destructuring milestone #453 is complete: corpus/correctness controls f128531, general recovery-range caching 06baa99, published results cda5125. The complete snapshot 20260827T162037Z records 17/17 lower Home means against JavaScript tsc 6.0.3 and native TypeScript/tsgo 7.0.2, using 30 round-robin samples after 3 warmups. All 1,530 timed samples and both documentation tables are verified. Destructuring measures Home 47.8 ± 14.0 ms versus native TS 63.4 ± 25.2 ms (1.32×); type predicates remains a narrow 1.05× mean lead. Prior losing baselines and substantial variance remain documented rather than filtered. The full checker gate passes 4,194 tests, and the unchanged corpus passes positive and automatic negative gates. README links the detailed methodology/results. Keeping this tracker open for broader fair coverage and strengthening narrow margins; local synthetic mean wins do not establish wins on every project or machine.

23 days ago

Progress under #455: added automatic predicate/assertion narrowing controls (cbbf52d), cached generation-guarded negative named-shape lookups (2de4f76), and published the complete benchmark snapshot (401d032). The scaled profile uses about 20% fewer instructions, but the accepted workload still has a narrow, noisy margin. Snapshot 20260827T163618Z retains all 30 interleaved samples after 3 warmups: 17/17 lower Home means against JavaScript TS 6.0.3 and native TS/tsgo 7.0.2. Type predicates is 87.7 ± 13.5 ms vs native TS 93.4 ± 17.1 ms (1.07×); null-safe access also has high variance. All 1,530 timed samples, README/docs tables, 4,196 checker tests, and nine automatic negative controls are verified. Both this tracker and #455 remain open: remaining profiled targets include first-time shape searches and repeated function-declaration scans, and local mean wins do not prove universal leadership.

23 days ago

Coverage now includes the same predicate generator at both 256 and 2048 families. Function-declaration indexing (983c2c5) improves the preserved before/after binaries, and the frozen scaling workload landed in 932797b. Crucially, the larger case disproves extending the small-suite wins to all sizes: authoritative snapshot 20260827T165255Z is 17/18 lower Home means, with large predicates Home 855.8 ± 42.1 ms vs native TS 7.0.2 382.3 ± 25.1 ms (2.24× loss). The small predicate case is 67.6 ± 2.6 ms vs 74.7 ± 6.0 ms (1.11× lead). Results, losses, source hashes, gates, and methodology are published in README and docs/docs/TS_PERFORMANCE.md via 5df5a8b. All 1620 samples and both tables are verified; 4198 checker tests and 13 automatic negative controls pass. No accepted source or samples were weakened/filtered. #455 and new #457 remain open, with the large scaling loss the next priority.

23 days ago

Pushed two verified general lookup optimizations (0494dc6, 3c6f4e6) and the full README/detailed-results update e3bd826. Snapshot 20260827T172600Z compares JS TS 6.0.3 and native TS 7.0.2, not duplicate native entries. All 18 frozen workloads × 3 compilers × 30 interleaved samples succeed; 3 warmups, no discarded samples. Home has lower means on 17/18. Large predicates improve from the prior published 855.8 ms to 592.0 ms, but native TS 7 is 377.6 ms: explicit 1.57× loss, so #457 remains OPEN. Small predicate variance also leaves #455 OPEN. Full checker 4,203/4,203; all 18 positive projects and 13 negative controls pass per compiler. Tables mechanically verified against raw results; Pickier reports 0 errors and the existing README fragment warning. Remaining work is general lookup/cache scaling, then broader fair coverage; universal leadership is not established.

23 days ago

Pushed 403482530 (skip impossible exact type-name scans), 8187216 (allocation-free FIFO cache tombstone reclamation), and 311cf8b (README/full results). All 4,207 checker tests, 18 shared projects, and 13 negative controls per compiler pass. Full snapshot 20260827T174752Z retains all 1620 successful samples with TS 6.0.3 versus native TS 7.0.2. Home has lower means on 17/18; large predicates remain 1.47× slower (557.5 ± 157.8 vs 380.1 ± 23.4 ms). Tables match raw data exactly, inputs unchanged, and the isolated cache comparison with higher new-binary means is documented rather than discarded. Pickier: 0 errors, existing README fragment warning. #455/#457 remain OPEN. Next profiled work is general named-object shape lookup; the goal is not complete.

23 days ago

Pushed 4fccb47 (member-fact candidate indexing with preserved ambiguous-name order), 5a537e0 (compile-time builtin lookup over the unchanged 308-entry list), and a7867e5 (README/full results). All 4,211 checker tests, 18 shared projects, and 13 negative controls per compiler pass. Snapshot 20260827T181303Z retains all 1620 successful samples against TS 6.0.3 and native TS 7.0.2. Home has lower means on 17/18; large predicates remain 1.19× slower with substantial variance. Both tables and source hashes verified. Prior losses and noisy/negative development observations remain in the docs; no universal leadership claim. Pickier: 0 errors, existing README fragment warning. #455/#457 remain OPEN; next profiled work is repeated whole-source setup/program/directive searches.

23 days ago

Following the compiler-version correction: origin/main already pins JavaScript TS 6.0.3 and native TS 7.0.2, and both installed binaries match. The runner currently records versions without rejecting a stale installation. Adding a preflight check against the manifest before creating timing output, with regression tests for old TS 7 dev builds and mismatched TS 6 versions. This does not alter benchmark inputs or timings.

23 days ago

Pushed 59b4ad1 (fix(bench): reject stale compiler installations) directly to main as configured. The runner now rejects any TS 6 or native TS 7 --version output differing from the exact manifest pin before creating results or validating/timing workloads. All five regression tests pass, including 7.0.0-dev.20260707.2 rejection. Local preflight verifies Version 6.0.3 and Version 7.0.2. Corpus and measured commands are unchanged.

23 days ago

Published e1a9e8f on origin/main after b1fe7c9 (shared exact source-marker searches) and 59b4ad1 (reject stale compiler installations). Full snapshot 20260827T183613Z compares verified TS 6.0.3, native TS 7.0.2, and Home: 17/18 lower Home means; large predicates remain 1.14x slower (491.0 ± 54.1 vs 430.2 ± 40.9 ms). All 1620 samples, balanced ordering, versions, both 18-row tables, and frozen predicate hashes were verified; no samples discarded. All 4216 checker tests, five harness tests, 18 positive projects, and 13 negative controls per compiler pass. README links the full methodology/history. Workstation variance remains explicit. #455 and #457 stay open; #464 tracks the stale, unvalidated container recipe separately. Next optimization target: repeated source queries in driver/program collection and remaining prefix scans, preserving source lifetime and parser semantics.

23 days ago

Pushed f18dd56 (perf(ts): jump to candidate directive lines) and 6a78f4e (docs(ts): publish directive-line performance results) to main as configured, no coauthors. The complete 30-round snapshot 20260827T185149Z uses verified TS 6.0.3 and native TS 7.0.2, with 17/18 lower Home means. Large predicates remain 1.18x slower (399.7 ± 25.6 vs 338.0 ± 16.1 ms); small predicates have a 1.40x lead (53.3 ± 0.8 vs 74.6 ± 2.8 ms). All 1620 samples and both tables verified, unchanged corpus hashes, all correctness gates pass. README/full docs retain variance, development samples, and earlier losses. #455 is addressed for its original small-case margin; #457 stays open for scaling and #464 for the unvalidated container recipe. Next profiled target is repeated fixed Function type construction during predicate matching, with metadata/lifetime/OOM invariants preserved.

23 days ago

Pushed b5b5bd9 (reuse builtin Function internal members with fresh outer identities) and f65df92 (full results/README table), as Chris Breuer with conventional commits and no coauthors. Snapshot 20260827T191750Z: TS 6.0.3 vs native TS 7.0.2, 30 interleaved runs after three warmups, all 1,620 samples successful and retained. Home has lower means on 17/18 cases; large predicates remain 1.07× slower (379.3 ± 15.8 vs 356.0 ± 20.1 ms), tracked in #457. Small predicates show a 1.47× lead. All 4,219 checker tests, 173 driver tests, five harness tests, 18 positive projects, and 13 negative controls per compiler pass. Frozen inputs unchanged. Exact pin/install checks confirm 7.0.2; npm latest was rechecked today. #467 documents a pre-existing Function predicate shape discrepancy, not fixed or counted as an accepted benchmark. #464 remains the unvalidated legacy Docker harness. Tables/methodology: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md

23 days ago

Pushed dad87a6 (exact necessary-condition filters for self-conditional-assignment scans), 999258e (honest near-tie report formatting), and 1ec7cfd (complete benchmark docs/README tables), as Chris Breuer with conventional commits and no coauthors. Snapshot 20260827T193257Z compares TS 6.0.3 vs native TS 7.0.2 over 30 interleaved runs after three warmups. All 18 Home means are lower, but the large-predicate case is effectively tied: 326.0 ± 10.0 vs 326.6 ± 8.3 ms, only a 0.2% difference. #457 remains open for a robust margin. All 1,620 timed samples succeeded and were retained; all correctness gates and frozen hashes pass. The 4,221 checker, 173 driver, and 10 harness/report tests pass. README shows the near tie explicitly, not a misleading 1.00× faster win. Remaining work includes exact program-source fact reuse, broader representative workload coverage, the #467 semantic discrepancy, and the #464 unvalidated Docker path. No universal or cross-platform leadership claim. Results: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md

23 days ago

Pushed 0612a90 (generic receiver/callback typing, fixes #479) and 262db42 (validation docs and explicit README snapshot labeling). Final validation: 4,232 checker + 99 program + 173 driver + 16 harness tests, 72 shared positive/negative CLI checks, and all 18 existing workloads/13 controls per compiler. No new speed claim: the timing table remains the measured 9e45e10 snapshot because the workstation was running competing builds/tests. The post-fix audit still rejects the valid generic async projection (#476), accepts wrong Promise.then/all result controls (#475), and reproduces global declaration erasure (#480); #478 remains open too. Async stays excluded from timing under #473. https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#generic-receiver-callback-validation-untimed

23 days ago

Latest main progress (small conventional commits, no coauthors):

  • 9817696: actual/forward global declarations preced the name-only fallback.
  • 8a737cd: config-relative explicit roots, fixes #483.
  • 6cba2f2: separate value narrowing from type lookup.
  • 16f84e7: imported-graph rejection gates and withdrawal of unsupported historical speed claims (#487).
  • 50abd82: reproducible global admission audit; 2e146e7: final results/documentation.

The fairness correction is important: Home silently accepts invalid imported-property checks in both graph workloads. The full suite now stops before any timing/results creation, and the README/report/docs mark those graph comparisons ineligible while retaining the observations. Other rows remain provisional pending broader negative controls. There is no all-benchmarks victory claim.

Final validation: 4,232 checker, 101 program, 173 driver, 69 CLI, and 25 harness/report tests pass. All 72 same-file declaration CLI checks pass; the default 132-check global audit retains 14 Home cross-file failures (#480). All 72 prior callback and 18 config-path controls pass. Eighteen positive workloads validate, but only sixteen Home workload gates pass; both graph gates correctly fail. Frozen predicate hashes are unchanged.

Async remains untimed: Promise.then/Promise.all wrong-result controls are still accepted (#475), the valid generic async projection still fails (#476), and diagnostic text remains tracked in #478 under #473. Next priority is real cross-file type ownership (#480/#487), broader admission checks, then fair retiming on a suitable machine. No new timings were collected under concurrent workstation load.

Details: https://github.com/home-lang/home/blob/2e146e71e/docs/docs/TS_PERFORMANCE.md#global-declaration-and-graph-admission-audit-untimed .

23 days ago

Pushed three small conventional commits to main under the configured user identity, without coauthors:

  • 134a910: assertion signatures return void, fixing #489.
  • 091f151: core checked metadata is retained with Compilation; the retained relation engine no longer points into a destroyed Checker.
  • 97ab7d4: results, README link, and explicit remaining ownership work.

The ownership work is a prerequisite, not completed cross-file linkage. #488 remains open after auditing interpretation tables still owned by Checker (including NoInfer/this markers, readonly/pattern indexes, and tuple/array origins). Equal numeric TypeIds from separate compilations are not interchangeable. #480/#487 still require actual owner-aware type transfer and resolution.

Validation: 4,236 checker, 175 driver, 101 program, 69 CLI, and 25 harness/report tests pass. All 36 shared assertion controls and 72 earlier callback controls match TS 6.0.3 and native TS 7.0.2. The global audit remains at 14 Home failures out of 132 checks. Sixteen workload gates pass, both graph gates fail, and no benchmark is readmitted. No new timing run or speed claim; published observations and frozen sources are unchanged.

Details: https://github.com/home-lang/home/blob/97ab7d4e4/docs/docs/TS_PERFORMANCE.md#checked-type-ownership-and-assertion-returns-untimed .

23 days ago

Pushed three small conventional commits to origin/main as the configured user, without coauthors:

  • 304fd5d: retained semantic interpretation metadata and transactional borrowed-leaf capture (closes #488).
  • cbc757d: mandatory variadic-tuple rejection gate, schema 3, and legacy-report qualification (closes #492).
  • 4e50814: detailed results and brief README correctness table.

The ownership boundary is now covered for the audited semantic tables, but types are still owner-relative. Actual cross-file transfer/resolution, merging, cycles, and file-order behavior remain under #480/#487. All 18 positive workloads pass; 16 workload gates pass and both graph gates still fail. Global declaration controls remain 44/44 per TypeScript baseline and 30/44 for Home: 14 failures in 132 total checks. No graph is readmitted.

Validation: 4,237 checker, 178 driver, 101 program, 69 CLI, and 29 benchmark-harness/report tests pass. All 42 tuple controls and 36 assertion controls agree across Home, TS 6.0.3, and native TS 7.0.2. No new timing run under concurrent workstation load. Historical tuple observations are provisional because they predate the new gate; frozen sources and timing observations are unchanged.

Details: https://github.com/home-lang/home/blob/4e50814e7/docs/docs/TS_PERFORMANCE.md#semantic-metadata-ownership-and-tuple-admission-untimed .

23 days ago

Pushed canonical payload transfer in e4c0a4caa, following the initialization cleanup fix 99a8b7866. Both use the configured author without coauthors.

Documentation and the README link are pushed in 1b83d1fa1.

The full suites pass 4,246 checker, 178 driver, 101 program, 69 CLI, and 29 benchmark-harness/report tests. The final focused transfer suite passes 8/8 (seven tests plus its module root), including canonical reuse of fourteen structural keys, an 8,192-node forward dependency chain, owner separation, source destruction, real literal/signature relations, invalid references/mappings, and exhaustive allocation-failure rollback.

A fresh ReleaseFast binary (SHA-256 860760ccee9bd0935b3371da534756bf148c733bce540d51c86714e96dce962c) was audited against version-verified TS 6.0.3 and native TS 7.0.2. All eighteen positive workloads, all 42 tuple controls, and all 36 assertion controls pass. Home still fails both graph rejection gates and fourteen global-declaration cases (Home 30/44; each TypeScript baseline 44/44). Sixteen workload gates pass, not sixteen proven-equivalent speed wins. Frozen tuple/predicate inputs are unchanged; no timings were collected.

The payload primitive is not yet called by program checking. CheckedTypes remapping, real HIR/source provenance, owner-aware caching/invalidation, typed import resolution, declaration merging, and cycle/file-order handling remain under #480 and #487. Neither graph is readmitted. Results, reproduction commands, limitations, and the linked README table are documented in the canonical transfer checkpoint. Local logs remain in bench/vs_tsgo/results/type-transfer.FHPXSf.

23 days ago

This checkpoint is pushed to origin/main in four conventional commits, using Chris Breuer as author without coauthors:

  • 778597026: owner-scoped checked semantic transfer with exhaustive field classification, deep ownership, invalid-reference/collision checks, and allocation-failure tests.
  • 84dc71ca5: independently compiled owner-isolation regression, including shared canonical guard signatures with distinct predicates and real source-owner/node references.
  • 50ff4add4: permanent imported-owner positive/negative audit in both root orders.
  • 3026742a0: results, reproduction commands, limitations, and linked README table.

Final tests: 4,249/4,249 checker; 179/179 driver; 101/101 program; 69/69 CLI; 33/33 harness/report. The focused transfer runner passes 4/4 including its module root. The ReleaseFast retry completed successfully; the final binary SHA-256 is 4ad8003e751e1471db6f7ea855c3bf8a3822063e89ddb793b85d3714efe93393. The first release attempt did not produce a verified artifact while disk space was low; it is not used as evidence.

Fresh CLI checks against version-verified TS 6.0.3 and native TS 7.0.2 confirm:

  • All eighteen positive workloads pass; Home passes sixteen workload gates and fails both graph rejection gates.
  • All 42 tuple and 36 assertion controls pass.
  • Global audit: TS 6 and TS 7 each 44/44; Home 30/44 (fourteen failures across 132 checks).
  • Imported-owner audit: TS 6 and TS 7 each 20/20; Home 8/20 (twelve failures across sixty checks), unchanged from the preceding binary. These include false acceptance, rejected valid predicate narrowing, and wrong diagnostic codes for private-origin assignments; the docs distinguish them.

#500 is complete for semantic cloning, not program integration. Neither transfer operation is called by program checking. #480/#487 remain open for source-aware typed lookup, merging, cycles, owner-specific caching/invalidation, and coordinated publication of payloads plus metadata. A metadata clone failure does not undo a previously committed payload transfer. Registry handles must not be treated as local HIR nodes, and name-keyed semantic records must not be blindly merged across owners.

No graph is readmitted and no timing run or speed claim was made. Frozen tuple/predicate inputs are unchanged. See the documented checkpoint; local evidence is retained in bench/vs_tsgo/results/checked-transfer.IO4A4Q.

23 days ago

Pushed three conventional commits to origin/main as Chris Breuer, without coauthors:

  • 9d8be00d7: staged payload transfer and atomic checked-semantic publication.
  • 202f24b9a: production source-owner/provenance registry, coordinated rollback, stale revision invalidation, and checked-source readiness guards.
  • 53dbc4796: verified results, reproduction commands, limitations, and README link.

Full tests pass: 4,252 checker, 183 driver, 101 program, 69 CLI, 33 benchmark-harness/report. Fourteen focused transfer tests include cancellation, existing-key/enum preservation, exhaustive allocation faults, and metadata failures after full payload preparation. Registry tests cover real source text/HIR, same-path replacement, invalid/stale nodes, rollback after a declaration mapping was prepared, and successful retry. The compiled-owner test now uses the production registry rather than a test mapper. Bind-only compilation is rejected as an unchecked owner; completed checking with diagnostics remains distinguishable from unchecked state.

Fresh ReleaseFast binary SHA-256: 6d6b278c9df4db5a67171436def69c720fbe4d91e3171e8221c6d9cb161f4134. Against verified TS 6.0.3 and native TS 7.0.2, results are unchanged: eighteen positive workloads pass; Home passes sixteen workload gates but fails both graph gates; all 42 tuple and 36 assertion controls pass; global audit Home 30/44 versus each baseline 44/44; imported-owner audit Home 8/20 versus each baseline 20/20. Thus fourteen global and twelve owner-audit Home cases still fail. Frozen tuple/predicate inputs are unchanged. No timing run or new speed claim.

#504 is complete for atomic publication/provenance. #480/#487 remain open: Program lookup does not consume these records yet. The shared transfer pool must use one registry's declaration handles for all declaration-bearing types, including the local owner; handles are not local HIR IDs. Readiness means phase completion, not semantic parity. Source-aware lookup, merging, cycles, imported-record caching, and dependent invalidation still need integration. Unregistering invalidates provenance but does not implement program-wide dependency invalidation.

See the documented checkpoint. Local evidence is retained in bench/vs_tsgo/results/owner-publication.xWNTr8. Neither graph is readmitted, and the remaining timing rows stay provisional.

23 days ago

Checkpoint 1f76193 is pushed to origin/main in five small conventional commits as Chris, without coauthors. #505 is complete: closure discovery prepares sources once, final checking reuses their HIR/binder owners, and conformance no longer reparses/rechecks the full graph. Fresh driver/program/CLI/conformance suites pass 186/105/69/1417 respectively; harness 33. The valid two-hop reference CLI probe is fixed, but its typed-global negative remains failing. Expanded globals: Home 32/56 vs TS 6.0.3/native TS 7.0.2 each 56/56; imported owners Home 8/20 vs 20/20. Original audit statuses/diagnostics are unchanged; new failures reflect broader controls. All 18 positive workloads pass, both graph rejection gates still fail. No retiming or universal-win claim. README table links the new prepared-program-discovery section in docs/docs/TS_PERFORMANCE.md. Next: actual source-owned global/import type lookup, not name-presence acceptance.

23 days ago

Checkpoint pushed to origin/main in three conventional commits: d4e63ff (56-case callable audit), 15f050f (distinct callable identities and scoped inference), 770834343 (full results plus README table). Verified installed baselines: TS 6.0.3 and native TS 7.0.2; exact-version preflight rejects the old dev build. Home improves 26/56 -> 56/56 on the untimed callable audit. Checker 4257/4257, conformance 1417/1417, driver/program/CLI 186/105/69, harness 35 all pass. Globals remain 32/56, imported owners 8/20, and both graph rejection gates still fail. No new timings or universal-lead claim. #507 is resolved; typed cross-file integration remains open in #480/#487. Details: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#callable-identity-and-scoped-inference-untimed

23 days ago

Pushed three small conventional commits as Chris Breuer, no coauthors: 79d9ce2 (fair untimed union audit), 7d16f7a (semantic fix, closes #511), 150655867 (README table/full results). Callable-union controls improve 120/256 to 256/256; both pinned TS baselines pass 256/256. Final checker 4,261/4,261 and conformance 1,417/1,417 pass, as do driver/program/CLI/harness suites. All 18 positive workloads pass; both graph rejection gates still fail, so those speed claims remain ineligible and #480/#487 remain open. Existing callable 56/56, tuples 14/14, globals 32/56 and imported owners 8/20 are retained. No retiming or universal-leadership claim. Full methodology, hashes, validation and remaining gaps: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#callable-union-predicates-and-receivers-untimed . Next required work remains actual source-aware typed global/import resolution.

23 days ago

Program identity/ownership milestone landed in ac52b62, 3f1c34e, 0a296c1, 347693b, and docs commit 0e3049c. New untimed bound-global audit: TS 6.0.3 56/56, native TS 7.0.2 56/56, Home 22/56 before to 44/56 after. The remaining 12 are retained wrong-type checks. Original global audit stays 32/56, imported-owner 8/20, and graph gates 0/2, so both graph rows remain ineligible and no timings were collected. Full checker 4,261/4,261 and conformance 1,417/1,417 pass. Continue typed linkage under #480 and #487.

23 days ago

Checked-owner / typed-global consumer checkpoint, pushed to origin/main:

  • 33d8c15c5: register checked source revisions, serialize parallel publication, and tombstone owners before replacement/destruction.
  • 76d6a8b2d: keep scanner recovery without typed storage unregistered.
  • a142705f1: receiving-checker value/type lookup contract, preserving local declaration precedence and globalThis lexical exclusions; tests cover structural types, calls, member/argument/assignment errors, and local shadowing.
  • e3d244bfa: full checkpoint and linked README summary.

This does not enable automatic cross-file type publication. Owner-aware generic/predicate/nominal metadata, declaration merging, and resolution independent of source order and cycles are still required. Program compilation still supplies presence-only names; this issue stays open.

Unchanged untimed controlsTS 6.0.3Native TS 7.0.2Home
Global declarations56/5656/5632/56
Bound-global discovery56/5656/5644/56
Imported owners20/2020/208/20
Import/re-export graph admission2/22/20/2

Full admission passes 16/18 workloads; both graph gates still fail and neither is readmitted for timing. No new timings or speedup claim. The installed versions are exactly TS 6.0.3 and native TS 7.0.2; the harness explicitly rejects 7.0.0-dev.20260707.2.

Validation: checker 4,264/4,264, conformance 1,417/1,417, program 110/110, driver 187/187, harness 38/38. ReleaseFast and Zig formatting pass. Targeted Pickier has no errors and one pre-existing README fragment warning. Local frozen evidence: bench/vs_tsgo/results/global-consumer.xZ8NXj, binary SHA-256 f401735aa016d571c2aa4def48f47f4ff435a100af98c3d37c5d61afab392f09.

23 days ago

Re-export prerequisite checkpoint is pushed: implementation 2e1f795f9, documentation/README 89d634162, tracked in #520.

Untimed controlTS 6.0.3Native TS 7.0.2Home beforeHome now
Entry-only/all-files discovery28/2828/2813/2828/28
Export origins and type-only restrictions32/3232/324/3232/32
Original imported graph admission2/22/20/20/2

The same-origin checks still reject genuine ambiguity and missing names. Type-only functions retain identity without becoming runtime values; named/star barrels and local shadows are covered. Cycles use a visited worklist, not a new depth cutoff. This is dependency/declaration provenance, not automatic checked-type transfer.

Global controls remain 32/56, bound-global controls 44/56, imported-owner controls 8/20; both baselines pass all. Overall Home admission remains 16/18, with just the original imported graph failures. No new timings were collected and neither graph speed claim is readmitted. Source-owned generic, predicate, nominal, and merged-declaration metadata remains the next linkage requirement.

Verified so far: checker 4,266/4,266, Program 117/117, harness 41/41, final ReleaseFast build and all listed audits. Complete conformance/remaining regression verification is still running, with results to follow in #520.

Full methodology, results, caveats and reproduction. Raw logs and the frozen binary remain at bench/vs_tsgo/results/reexport-discovery.rFhIvz; binary SHA-256 bff8e072e39c79f0d44e360b0b36ed5b984fd71183debb8e8736efa1aa6e6e3c.

23 days ago

Nominal-identity checkpoint pushed to origin/main: audit ab691ca, expanded fairness controls e40a4d5, implementation 4ae6956, documentation ef076c9. Synthetic imported-class brand properties are removed; real member-origin metadata survives nested relations, substitutions and type transfer.

Verified TS 6.0.3 / native TS 7.0.2: nominal audit 52/52 each. Home improves 30/52 -> 36/52 and existing owner audit 8/20 -> 10/20. Callable identity 56/56 and callable unions 256/256 remain passing. Re-export discovery 28/28, export origins 32/32, globals 32/56, bound globals 44/56, original graphs 0/2 and full admission 16/18 are unchanged. No new timings; both graph timing exclusions remain mandatory. The 16 failing nominal controls remain visible, so this is not complete imported-type parity.

Final verification: checker 4270/4270; conformance 1417/1417; driver 187/187; Program 117/117; CLI 69/69; harness 44/44. Zigfmt passes; Pickier has zero errors and one pre-existing README fragment warning. README includes a concise table and link to the methodology/results section: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#imported-nominal-identity-without-synthetic-properties-untimed

23 days ago

Pushed another correctness checkpoint in small conventional commits as Chris Breuer: cce3286, 226da38, b45b038, 3567e26 (#522). Bound class export audit improves 22/52 -> 48/52; nominal identity improves 36/52 -> 40/52. Verified competitor versions remain TS 6.0.3 vs native TS 7.0.2; the old dev version is rejected. README table and detailed docs updated. Checker 4271/4271, conformance 1417/1417, Program 119/119 and harness 47/47 pass. No new timing claims; original graph gates remain 0/2. Follow-up #523 targets imported class static-value consumers.

23 days ago

Pushed another verified checkpoint in small conventional commits as Chris Breuer, without coauthors: 232961504, 170613d, 8969812, bca0fad, c2331ba, cdcb60b, f5f3681 (#523). Imported static-value audit improves 52/84 -> 84/84; bound-class controls 48/52 -> 52/52; nominal identity 40/52 -> 42/52. Verified TS 6.0.3 vs native TS 7.0.2; no duplicate tsgo competitor. README table and detailed docs updated. Full checker 4274/4274, conformance 1417/1417, Program 120/120, driver 187/187, CLI 69/69, harness 50/50 pass. Overall admission remains 16/18, original imported graph gates 0/2; no new speed claims. Next semantic linkage work: #524, with inheritance still tracked under #521/#487.

23 days ago

#524 checkpoint: d7f80bd adds 100 fair generic-class controls; f0d8481 and af11e4e add the parsed-field/source-owned metadata foundation; ca94ccc documents the baseline in TS_PERFORMANCE.md and README. TS 6.0.3 and native TS 7.0.2 pass 100/100; Home 50/100. Consumer integration is still pending, and the collector stays off the production path until it is used. Original imported-graph admission remains 0/2; no new timing claim. Details and targeted test results are on #524.

Sign in to comment on this issue.