ReviewOS

home-lang/home

Track TypeScript frontend benchmark leadership

#416
Open chris opened this 23 days ago · 283 comments
23 days ago

Goal

Maintain a fair, reproducible TypeScript frontend performance suite and improve Home until it leads JavaScript tsc 6 and stable native TypeScript 7 across every accepted workload.

Benchmark rules

  • All compilers receive identical valid source graphs and compiler options.
  • Every compiler must validate successfully and silently before timing, and reject the same invalid controls with the expected diagnostics.
  • All selected workloads must pass admission before any timing or result-directory creation; no failing row is silently omitted.
  • Compiler versions and generated workloads are pinned.
  • JavaScript TypeScript 6 and native TypeScript 7 are installed in isolated prefixes.
  • Measurements rotate compiler order within every round to balance workstation load.
  • Workloads represent general compiler behavior, never benchmark-specific shortcuts.
  • Results, environment details, caveats, and reproduction commands stay documented.

Landed foundation

  • Nineteen deterministic workloads covering startup, files, complex types, module graphs, TSX, inference, control flow, predicates at two scales, null-safe access, destructuring, overloads, classes, structural objects, interface composition, variadic tuples, checked JavaScript, and recursive generic consumers
  • Pinned JavaScript tsc 6.0.3 and stable native TypeScript 7.0.2 toolchain
  • Interleaved Hyperfine measurement schedule and silent-success validity gate
  • Release allocator, reusable source I/O, and bounded large-program parallelism
  • Cached source facts, bind-only export analyses, and projected export-name sets
  • Indexed lexical declarations, interface merge predecessors, namespaces, annotations, and validated type display names
  • Pruned provably irrelevant overload, inference, import, expando, and compatibility work
  • Relation-cache working-set retention and single-probe insertion
  • Full performance documentation and linked README summary

Current correctness and measured status

Implementation 1cfc33c (#536), audit d95dfaa (#541), and verified README/report 707045c are pushed to main as Chris with no coauthors. TS 6.0.3 and native TS 7.0.2 are verified; TS7/tsgo is one competitor.

The prepared-owner CommonJS display query removes the extra full source compilation and raw-text recovery. Program140/140, conformance1418/1418, CLI69/69 and harness75/75 pass; unchanged checker/driver targets verify from cache. All19 unchanged admission gates and all15 complete audit case sets preserve every previously passing case. Disk-interrupted logs remain alongside complete retries; no partial audit was accepted.

Same-correctness 30-round alternating comparison: import graph32.4±1.7ms to28.4±0.6ms, 12.4% less time and30/30 paired wins. Barrel27.9±5.2ms to27.3±4.2ms, only2.3% lower with17/30 paired wins: inconclusive, not a reliable improvement. All60 rounds/120 successful samples retained.

Full measurement20260828T234350Z validates570 rounds/1710 successful finite samples, with all513 input files byte-for-byte unchanged. Home has lower means on19/19: import graph28.1ms vs TS7 47.0ms (1.67x), barrel25.6ms vs42.7ms (1.67x), large predicates340.5±18.2ms vs362.2±30.4ms (1.06x;29/30 paired wins). Several rows have substantial shared-host variance. Independent confirmation20260828T234818Z retains30 rounds/90 samples: large predicates Home358.6±11.7ms vs TS7 388.5±16.7ms (1.08x;30/30 paired wins). It is separate, not substituted or pooled. Selected compiler/native-payload/runtime/launcher paths and hashes match before and after both measurements; automated harness provenance is tracked by#544.

CommonJS instance typing is NOT admitted for timing: TS6/TS7 pass66/66, Home22/66, with all44 missing wrong-type/missing-member rejections retained under#541. Export-list controls remain80/96 (#540). Other remaining gaps include owners12/20, nominal origins44/52, globals32/56 and bound globals44/56. The broader goal stays open: real projects, additional rejection coverage, other platforms and semantic correctness remain unproven. Next priorities are actual source-owned CommonJS require types#541 and precise external hidden-binding diagnostics#540.

Frozen candidate commonjs-query.hyU20d/release-v1/bin/home-tsc, SHA-256573257a819a178c9387f6d02a7992c08f995185f5dbc94034eb5eadc0ae956c0. Full results, retained history and reproduction.

Historical indexed-export checkpoint

Implementation b7b9dd9 (#537) and parser ownership fix d6878e8 (#538), with verified README/report 24a34f4, are pushed to main. Compiler versions are verified TS 6.0.3 and native TS 7.0.2; TS 7/tsgo is one competitor.

All 19/19 unchanged workload admission gates pass. Full measurement 20260828T231439Z validates 570 rounds / 1,710 successful finite samples; fresh generation matches 513 measured input files. Home has lower means on 19/19 workloads, but large predicates have only a noisy 1.02x lead: 371.6 ± 125.5 ms versus TS 7 377.7 ± 66.4 ms, 25/30 paired wins. Independent 30-round confirmation 20260828T231856Z retains all 90 samples: Home 320.4 ± 2.8 ms versus TS 7 331.4 ± 4.6 ms (1.03x; 29/30 paired wins). Confirmation is separate, not substituted into the full table.

The same-correctness alternating before/after comparison for #537 improves 525.6 ± 12.4 ms to 353.5 ± 10.5 ms, 32.7% less time and 30/30 paired wins. Deterministic source visits drop 65,536 to 256 for 128 independent exports. Bound-owner edge indexing preserves semantic query work; no control or failed observation was removed.

New exported-variable-list audit improves 0/96 to 80/96. All 32 positives, 32 wrong-type controls and 16 barrel hidden-name controls pass; 16 direct-hidden diagnostics remain TS2305 instead of TS2459 (#540). Existing audit scores remain: factory 240/240, recursive 288/288, generic classes 120/120, static 84/84, bound classes 52/52, callable identity 56/56, callable unions 256/256, graph discovery 28/28, export origins 32/32, owners 12/20, nominal origins 44/52, globals 32/56, bound globals 44/56. Both competitors pass every audit.

Verified suites: checker 4286, conformance 1417, Program 137, parser 891, driver 187, CLI 69, emitter 499 and benchmark harness 72 tests all pass. Pickier reports no errors and one pre-existing README fragment warning. Frozen evidence export-index.NVcIdu, SHA-256 615e9fa1f78c2cad17a0b8911b897ede73c00422138d6ecbb2b74801d4564f14.

Next: #536 removes redundant CommonJS export-query compilation; #540 adds external owner-local diagnostic facts. Correctness gaps, expanded rejection coverage, real projects and cross-platform measurements keep the overall goal open. Shared-host synthetic results are not universal benchmark leadership. Full results and reproduction.

Historical exported-factory checkpoint

Implementation de8fe28 (#534), documentation/README f3740df. Executables are verified TS 6.0.3 and native TS 7.0.2; native TS7/tsgo is one competitor.

All 19/19 workload admission gates now pass for all three compilers. Both original graph projects and their unchanged TS2322/TS2339 rejection controls pass; no failing workload was removed. The 240 exported-factory controls improve from Home130/240 to240/240. Recursive288/288, generic classes120/120, static84/84, bound classes52/52, callable identity56/56, callable unions256/256, graph discovery28/28 and export origins32/32 remain passing. Imported owners improve10/20 to12/20; nominal origins44/52, globals32/56 and bound globals44/56 remain incomplete. Both competitors pass all these audit cases.

Full relevant suites: checker4286/4286, conformance1417/1417, Program133/133, driver187/187, CLI69/69, source-owned focus10/10, harness69/69.

Complete measurement 20260828T224220Z: 30 interleaved rounds after3 warmups, all570 round files /1710 samples validate; fresh generation matches all513 measured input files. Shared Apple M3 Pro workstation with unrelated CPU/filesystem activity. Home has lower means on 18/19 workloads, not universal leadership. Import graph33.7ms vs TS7 50.8ms (1.51x); barrel graph25.1ms vs41.1ms (1.63x). Large predicates lose: Home541.3 ±50.7ms vs TS7 380.6 ±44.8ms, 1.42x slower and0/30 paired wins. That losing row is retained in README and full docs.

Next: #537 establishes and fixes the large-predicate scaling cause against a same-correctness controlled baseline; #536 removes redundant CommonJS export-query compilation. Remaining semantic failures, broader rejection coverage, real-project and cross-platform measurements keep the overall goal open. Frozen evidence: graph-types.4EsbvV; binary SHA256 9f5e333beaf9828a9720ce260ae05a872ebcea3bb51bf5785ffa3ccd7b72f1bc. Documentation: docs/docs/TS_PERFORMANCE.md#exported-factory-checkpoint-performance.

Historical checkpoint before exported-factory typing

Checkpoint: implementation 3b7f0ea (#524), recursive throughput workload de72563, report-integrity fix 74d1163, and documentation/README 91d6ca8. Pinned executables are TS 6.0.3 and native TS 7.0.2; TS 7 and tsgo are one competitor.

The original admission set remains 16/18 for Home: both imported graph rejection gates fail and were not timed. The added recursive workload passes its positive and nine appended negative controls, making expanded admission 17/19 (both competitors 19/19). No failure is removed by expanding the denominator.

Untimed correctness gateTS 6.0.3Native TS 7.0.2Home
Global declarations56/5656/5632/56
Bound-global discovery56/5656/5644/56
Imported owners20/2020/2010/20
Nominal identity52/5252/5244/52
Imported generic classes120/120120/120120/120
Recursive generic consumers288/288288/288288/288
Import/re-export graph admission2/22/20/2

Lazy source-owned definitions improve recursive controls from 112/288 to 288/288 and imported generic classes from 118/120 to 120/120. Local non-exported classes remain non-exported; transparent aliases preserve their target's origin. No fixed-depth unfolding or new permissive fallback. Inheritance, global/owner typing, broader generic forms and original graph linkage remain open (#521, #480, #487).

Fresh full timing 20260828T221149Z has lower Home means on 17/17 admitted timed workloads, with 510 complete round files and 1,530 successful samples. Apple M3 Pro, 30 interleaved runs after three warmups, shared-workstation load. Recursive generics: Home 29.7 ± 0.2 ms, native TS 7 71.8 ± 1.1 ms, TS 6 151.7 ± 2.2 ms (2.42× lower mean). Large predicates: Home 377.0 ± 100.9 ms, native TS 7 393.6 ± 94.1 ms (1.04× lower mean; noisy). Other rows also have substantial variance.

Independent confirmation 20260828T221611Z retains 60 complete rounds / 180 successful samples. Recursive generics: Home 29.6 ± 0.7 ms vs native 73.1 ± 3.9 ms (2.47×; Home faster in 30/30 paired rounds). Large predicates: Home 349.9 ± 17.0 ms vs native 392.7 ± 83.0 ms (1.12×; 28/30 paired rounds). Confirmation does not replace or get averaged into the full run. The predecessor fails recursive rejection controls and is ineligible for a before/after timing claim.

Exact-source tests: checker 4285/4285, conformance 1417/1417, Program 131/131, driver 187/187, CLI 69/69, focused source-owned 9/9, harness 66/66. Release SHA-256: 267691e33056e2c4a8b23b757bc3eed19c8b3d90fa9407120b8985834a844ccd. Reporting now rejects incomplete/extra rounds, incorrect compiler coverage/order, malformed JSON, and failed/invalid samples instead of publishing partial averages.

Full results, variance, preserved history and reproduction. Correctness details.

Not complete: these are local synthetic observations under shared-host load, not universal, real-project or cross-platform leadership. The two original graph gates and broader semantic coverage still fail or remain unverified. The tracker stays open.

Historical measured snapshot (not current admission)

Apple M3 Pro, 30 interleaved runs after three warmups; raw full-suite result 20260827T202656Z, compiler commit 9e45e10, documentation commit 75e02f3. Every observation is retained, including variance and outliers.

Workloadtsc 6.0.3native TS 7.0.2Home 0.1.0Home vs fastest competitor
startup64.4 ± 1.8 ms42.2 ± 11.3 ms3.9 ± 2.7 ms10.82× faster
many_files213.2 ± 14.8 ms53.5 ± 3.1 ms30.0 ± 1.5 ms1.78× faster
deep_types127.9 ± 2.2 ms52.6 ± 1.5 ms12.9 ± 0.3 ms4.09× faster
import_graph129.2 ± 1.9 ms45.0 ± 0.9 ms25.8 ± 1.1 msIneligible: fails semantic controls
reexport_graph94.7 ± 3.0 ms40.7 ± 0.9 ms26.8 ± 0.6 msIneligible: fails semantic controls
tsx_components159.1 ± 1.2 ms46.3 ± 0.9 ms21.3 ± 0.3 ms2.17× faster
generic_calls177.5 ± 4.4 ms55.4 ± 11.2 ms22.0 ± 1.8 ms2.52× faster
control_flow212.2 ± 127.9 ms63.1 ± 22.3 ms32.9 ± 3.8 ms1.92× faster
type_predicates237.3 ± 14.0 ms72.4 ± 10.8 ms46.5 ± 19.5 ms1.56× faster
type_predicates_large1027.8 ± 117.6 ms348.8 ± 15.7 ms322.1 ± 13.3 ms1.08× faster
null_safe_access206.3 ± 12.4 ms60.3 ± 2.4 ms40.6 ± 1.8 ms1.49× faster
destructuring144.3 ± 11.1 ms48.5 ± 1.1 ms35.3 ± 0.8 ms1.38× faster
overload_resolution222.7 ± 20.6 ms71.6 ± 10.7 ms30.9 ± 2.9 ms2.32× faster
class_hierarchy200.0 ± 17.6 ms55.8 ± 4.5 ms29.8 ± 1.1 ms1.87× faster
structural_objects197.7 ± 9.7 ms60.7 ± 2.8 ms31.5 ± 1.1 ms1.93× faster
interface_composition233.3 ± 43.6 ms76.2 ± 30.3 ms46.5 ± 3.4 ms1.64× faster
variadic_tuples268.4 ± 33.0 ms81.0 ± 8.5 ms46.2 ± 8.3 msProvisional: older admission schema
checkjs_jsdoc246.4 ± 48.7 ms63.0 ± 16.6 ms41.2 ± 6.8 ms1.53× faster

Historical snapshot: 18/18 lower Home means were recorded, with stronger primitive-return checking. This is not current acceptance: the two graph claims were subsequently withdrawn and later compiler changes have not been retimed. Large predicates have a 1.08× mean lead. The predeclared independent 30-round confirmation 20260827T203044Z records Home 342.5 ± 29.3 ms vs native TS 7 370.2 ± 22.0 ms (1.08× lead); TS 6 is 1086.3 ± 96.2 ms. Home is faster than native in 29/30 paired large-case rounds in the full run and 26/30 in the confirmation. The confirmation does not replace or get averaged into the full table. All 1,710 timed samples succeeded; exact versions, balanced ordering, published tables, preserved binary, and frozen predicate hashes were verified.

All 99 program, 4,226 checker, 173 driver, and 16 harness/report tests pass, as do all 18 shared positive projects and 13 negative controls per compiler. Five new return-contract regression groups have been independently checked with the same CLI inputs against both TS baselines (#474). Async is not an accepted workload: #475 and #476 still fail semantic controls, and #478 tracks diagnostic wording. Do not infer full TypeScript parity from these counts.

These are local synthetic results, not proof of universal, real-project, or cross-platform leadership. Several rows have substantial variance; no observations were discarded. The correctness fix is not itself claimed as a performance optimization. Full methods, history, and reproduction.

Previous 18-workload snapshot (retained)

Previous measured snapshot

Apple M3 Pro, 30 interleaved runs after three warmups; raw full-suite result 20260827T195539Z, compiler commit d330198, documentation commit 20084a4. Every observation is retained, including variance and outliers.

Workloadtsc 6.0.3native TS 7.0.2Home 0.1.0Home result
startup66.7 ± 2.5 ms42.0 ± 9.6 ms3.6 ± 0.4 ms11.73× faster
many_files215.4 ± 3.3 ms56.7 ± 7.5 ms32.4 ± 6.3 ms1.75× faster
deep_types146.0 ± 8.6 ms58.3 ± 3.7 ms14.1 ± 0.8 ms4.12× faster
import_graph139.0 ± 4.4 ms49.8 ± 4.1 ms29.3 ± 2.0 ms1.70× faster
reexport_graph111.0 ± 46.4 ms47.0 ± 19.2 ms31.1 ± 6.1 ms1.51× faster
tsx_components178.0 ± 25.2 ms50.2 ± 1.6 ms23.3 ± 4.1 ms2.16× faster
generic_calls188.4 ± 12.9 ms57.3 ± 3.9 ms23.2 ± 2.0 ms2.47× faster
control_flow190.2 ± 4.8 ms59.5 ± 2.2 ms33.6 ± 5.4 ms1.77× faster
type_predicates237.8 ± 12.7 ms70.9 ± 2.0 ms41.9 ± 0.8 ms1.69× faster
type_predicates_large1010.4 ± 25.3 ms351.4 ± 15.2 ms323.8 ± 10.2 ms1.09× faster
null_safe_access191.9 ± 4.1 ms57.2 ± 1.1 ms38.7 ± 0.5 ms1.48× faster
destructuring138.4 ± 1.6 ms47.3 ± 1.0 ms34.4 ± 0.5 ms1.37× faster
overload_resolution203.1 ± 3.4 ms64.6 ± 1.4 ms29.1 ± 0.6 ms2.22× faster
class_hierarchy186.1 ± 7.9 ms53.4 ± 7.8 ms28.1 ± 0.4 ms1.90× faster
structural_objects185.8 ± 2.9 ms58.1 ± 1.6 ms30.3 ± 0.6 ms1.92× faster
interface_composition214.9 ± 41.7 ms64.7 ± 4.3 ms45.6 ± 6.0 ms1.42× faster
variadic_tuples252.9 ± 6.3 ms77.7 ± 2.5 ms42.4 ± 1.0 ms1.83× faster
checkjs_jsdoc211.5 ± 27.6 ms54.3 ± 1.2 ms36.9 ± 0.9 ms1.47× faster

Then-reported snapshot: 18/18 lower Home means; retained as history, not current admission or a restored graph speed claim. Large predicates have a 1.09× mean lead. The predeclared independent 30-round confirmation 20260827T200026Z records Home 327.1 ± 10.4 ms vs native TS 7 359.7 ± 14.2 ms (1.10× lead). The confirmation does not replace or get averaged into the full table. All 1,710 timed samples succeeded; exact versions, balanced ordering, both tables, and frozen predicate hashes were verified. All 99 program, 4,221 checker, 173 driver, and 16 harness/report tests pass, as do all shared positive projects and negative controls.

These are local synthetic results, not proof of universal, real-project, or cross-platform leadership. Full methods, retained history, and reproduction: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md

Earlier 13-workload snapshot (retained)

Earlier snapshot

Apple M3 Pro, 30 interleaved runs after three warmups, mean wall time; raw result ID 20260827T085121Z. Background workstation activity increased absolute time and variance; the report retains every sample and rotates compiler order.

Workloadtsc 6.0.3native TS 7.0.2Home 0.1.0Home result
startup109.0 ms60.2 ms6.7 ms8.99× faster
many_files426.6 ms93.6 ms54.1 ms1.73× faster
deep_types260.0 ms90.3 ms28.9 ms3.12× faster
import_graph260.0 ms79.3 ms48.2 ms1.65× faster
reexport_graph195.6 ms72.6 ms57.9 ms1.25× faster
tsx_components364.1 ms90.5 ms44.5 ms2.03× faster
generic_calls360.5 ms93.8 ms51.7 ms1.81× faster
control_flow392.2 ms100.3 ms77.1 ms1.30× faster
overload_resolution491.2 ms132.3 ms88.5 ms1.49× faster
class_hierarchy406.5 ms96.0 ms83.7 ms1.15× faster
structural_objects361.8 ms102.3 ms69.4 ms1.47× faster
interface_composition532.6 ms133.1 ms122.8 ms1.08× faster
variadic_tuples634.1 ms160.8 ms153.5 ms1.05× faster

Then-accepted suite: 13/13 lower Home means.

Next coverage

  • Preserve actual global declaration types, merging and lexical isolation across files (#480)

  • Preserve generic imported/re-exported types and owner metadata, including source-order/cycle handling; readmit graph timing only after the unchanged controls pass (#487)

  • Add shared async/await and Promise type-propagation coverage with negative controls (#473; remaining #475, #476, #478)

  • Validate the legacy container path before claiming cross-platform results (#464)

  • Resolve independently tracked semantic/source-lifetime gaps (#467, #472)

  • Add a fair emit workload when output semantics are validated across all compilers

  • Add pinned real-world projects only where all compilers accept the same graph and configuration

  • Profile and resolve every regression or loss introduced by accepted workloads

  • Keep README and detailed performance documentation synchronized

Commit links and before/after measurements are maintained in the issue comments. The tracker remains open while coverage expands.

23 days ago

Zod admission update: #627 landed on main at 2de0edb. ReleaseFast diagnostics on the frozen 106-file Zod 4.5.2 graph are now 710 (down from 833); TS7006 is 118 (down from 241). The exact identity diff is 123 removed and 0 added. Evidence is documented in docs/docs/TS_PERFORMANCE.md#generic-member-assigned-callback-context.

23 days ago

Scoped correctness follow-up #633 is now complete on main (4446c5864, c5c3fd009). TypeScript 6.0.3, native TypeScript 7.0.2, and Home agree on the focused dependent-default accept/reject oracle. The pinned Zod 4.5.2 audit moved 710 → 604 diagnostics, removing 106 with 0 added. Full evidence: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#dependent-generic-defaults

Follow-up coverage remains issue-driven: #634 tracks symbolic indexed-access defaults and #639 tracks the recursive constraint fixed-point limitation found by negative-control testing.

23 days ago

Correctness follow-up #634 is complete on main (f6a014d4b, 773af2405). TypeScript 6.0.3, native TypeScript 7.0.2, and Home agree on every focused symbolic indexed-default accept/reject location. The production Zod identity set is unchanged at 604 diagnostics with zero additions/removals. Evidence: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#symbolic-indexed-access-generic-defaults

Recursive declaration-owned fixed points remain tracked separately in #639.

23 days ago

Correctness update: #639 is fixed on main in 7d7cf23f8, with evidence in f7fa8f9c5.

Home now rejects both recursive generic-default constraint controls (TS2344/TS2344), matching the pinned TS 6.0.3 and native TS 7.0.2 semantic outcomes while preserving valid, readonly, owner-local, and two-file Program controls. The complete Zod identity audit removes four target TS2345 diagnostics, adds none, and leaves 600 remaining for subsequent issue-driven reductions.

Final CLI validation also exposed a separate pre-existing crash for --skipLibCheck and --ignoreConfig; it is isolated in #645 and linked to the existing TS5112 issue #486.

23 days ago

Correctness update: #645 is fixed on main in d318b0c28, with evidence in 5cbf35e3b.

Home now parses --ignoreConfig and --skipLibCheck as typed booleans, preserves positional files, honors explicit true/false overrides, suppresses only declaration checker diagnostics for skipLibCheck, retains syntax diagnostics, and completes the six-case TS6/TS7 oracle without the former exit 139. #486 remains open for the absent-flag TS5112 diagnostic; the independently exposed cross-file declared-global reduction is recorded on #480.

23 days ago

Correctness checkpoint #480 is complete and documented in 6b1368502. Home now matches pinned TypeScript 6.0.3 and native TypeScript 7.0.2 on all 60/60 global controls and 56/56 bound-global controls, including cyclic owners in both explicit root orders. ReleaseFast passes, but timing was intentionally skipped under concurrent load. The unchanged Zod graph remains 600 diagnostics; imported-owner rest signatures (16/20 total) and inherited nominal origins (44/52) remain open, so no benchmark-leadership scope is overstated.

23 days ago

Current TypeScript checkpoint is published in 4fda2da9e.

  • d0b9ef0aa (#651) removes quadratic CommonJS owner relocation by keeping CommonJS modules out of script-global publication.
  • e4e9d16c2 (#652) removes complete-HIR projection scans for already-typed receivers (82.4B -> 3.09B retired instructions on the unchanged large-predicate corpus).
  • c215ebe3d (#653) restores 95/95 benchmark harness tests without changing audit cases or oracles.
  • #487 is complete: graph types 720/720, discovery 84/84, export origins 96/96, owners 60/60, nominal origins 156/156. Globals 180/180, bound globals 168/168, CommonJS types 198/198, CommonJS discovery 132/132, and export lists 384/384 also pass.

Final schema-3 result 20260905T225537Z (TS 6.0.3, native TS 7.0.2, Home; 30 interleaved rounds after 3 warmups; verified unchanged provenance) records Home lower means on 20/20 workloads and 600/600 paired wins. Narrowest mean lead: 1.60x on type_predicates_large; CommonJS: 1.87x. One unrelated single-core fuzz process was present throughout and is disclosed in the docs; no sample was removed or rerun. The preceding honest discovery screen 20260905T223009Z remains documented at 17/20.

23 days ago

Published the latest untimed real-project correctness checkpoint in 4ef52ad, linked from the README. Pinned Zod 4.5.2 moved from 602 to 523 diagnostics (79 unique identities removed, 0 added) through 2e749f7 (#654) and 197ee07 (#534). The synthetic schema-3 benchmark remains 20/20 Home mean wins and 600/600 paired wins from the prior admitted checkpoint; Zod timing remains gated on zero diagnostics under #548.

23 days ago

Published the next untimed Zod correctness checkpoint in 6763779 after #656 (ab86dad): 523 -> 489 diagnostics, 34 TS2339 keys removed and 0 added; 113 unique removals versus the immutable 602 baseline. The admitted synthetic benchmark snapshot is unchanged.

23 days ago

Published the #657 semantic checkpoint on origin/main: 5f31fc7f1 implementation and 2143a4623 documentation. The fair cyclic callable oracle is 0 across Home/TS6/TS7; invalid controls match exactly; Program 189/189 and checker 4,353/4,353 pass. Zod stays 489/484 with zero identity churn. Two broader policies were measured and rejected (92 added keys; 156 added TS7006 keys), and those results are retained in the docs: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#parameterized-built-in-callable-transfer

23 days ago

Published the #659 conditional indexed-alias checkpoint: implementation 1332e4e6f, documentation 5d72ab3fd. Fair unqualified and qualified strict controls match TypeScript 6.0.3 and native TypeScript 7.0.2: constrained keys are clean and unconstrained keys retain one TS2344. Pinned Zod moves 448/443 -> 446/441, exactly 2 TS2344 removed and 0 keys added; cumulative immutable-baseline delta is 156 unique removals / 0 additions. Full checker 4,355/4,355 and Program 189/189 pass. No timing claim was admitted due outstanding diagnostics and shared-host build contention.

23 days ago

Published the #660 Map-entry tuple audit on main.

The fair three-engine oracle is exact: valid pipeline clean; invalid control one TS2322 from string[] to number[] in Home, TS 6.0.3, and TS 7.0.2. Pinned Zod improves 446/441 to 440/435 diagnostics/unique identities with zero additions. Timing is intentionally excluded because Zod is not yet diagnostic-clean and ReleaseFast built on a contended host. #416 remains open.

23 days ago

Published the #661 nested default-lib alias audit on main.

The exact three-engine oracle accepts nested PropertyKey and retains one TS2304 for MissingKey. Pinned Zod improves 440/435 to 436/431 diagnostics/unique identities with zero additions. Timing is excluded while the graph is not diagnostic-clean and the host is contended. #416 remains open.

23 days ago

Fair benchmark record update: #662, #663, and #664 are complete on main and documented in f26b768: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#zod-collection-and-generic-relation-audit-662664

Three focused positive/negative oracles now match TypeScript 6.0.3 and the native TypeScript preview for collection interfaces, conditional object spreads, and transitive generic argument constraints. The unchanged Zod 4.5.2 graph improves from 436 diagnostics / 431 unique identities to 430 / 425, with 6 removals and 0 additions; cumulative improvement from the immutable baseline is 172 unique removals and 0 additions. Timing is deliberately excluded because the shared host was contended and Home still reports diagnostics where TypeScript reports zero. Full checker and Program suites and a clean-cache ReleaseFast build pass.

23 days ago

Fair benchmark record update: #665 is complete and documented in a903452: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#partially-transferable-imported-class-methods

The admitted projection-only design matches TypeScript 6.0.3 and the native preview on a strict positive/negative two-file oracle, then removes 30 TS7006 identities from the unchanged Zod 4.5.2 graph with 0 additions (430/425 diagnostics/unique identities to 400/395). Two runs are byte-identical. A broader whole-class candidate crashed the corpus and was rejected without a commit. Timing remains excluded because the host was contended and Home still does not type-check the graph cleanly.

23 days ago

Imported overloaded object-literal context is now audited on main via #667 (b6f5eef4a, docs 9c13f230f). The strict oracle is an exact three-engine match; the unchanged Zod admission guard has 0 identity additions and byte-identical baseline/candidate output.

README summary: https://github.com/home-lang/home#typescript-performance Detailed audit: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#imported-overloaded-object-literal-context

No timing claim was admitted because the shared host was contended and Zod still has diagnostics.

23 days ago

Standard imported Extract<T, U> transfer is complete via #668 (40160d029, docs 13d74ca52). The new strict conditional mapped-handler oracle is an exact three-engine diagnostic-code match, including the distributive nonmatch and never fallback controls.

The unchanged Zod graph remains a valid zero-addition admission result; no timing claim was made on the contended host.

README: https://github.com/home-lang/home#typescript-performance Detailed audit: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#imported-extract-conditional-handlers

23 days ago

TS correctness/performance track update: #669 is closed on main. Imported nested indexed-access key domains now match TypeScript in the focused fair oracle, with explicit no-widening guards for missing and partial union coverage. Zod admission is deterministic and unchanged at 400 diagnostics / 395 identities, zero added/removed; it remains excluded from timing until diagnostic parity. Commits: 12e1c1d6c, 1ea1d2a7a, 15a508a11. Evidence: /home-lang/home/issues/669#issuecomment-5561267845

23 days ago

TS correctness/performance track update: #670 is closed on main. Qualified namespace declaration admission removes 6 false Zod TS2339 identities with zero additions (400/395→394/389), while keeping strict unsafe-graph guards. The separate 16 handler TS7006 sites remain for the next exact slice. Commits: 24f4376f1, e8a92aa2a. Evidence: /home-lang/home/issues/670#issuecomment-5561365837

23 days ago

Correctness checkpoint #671 is complete on origin/main (290487c0f, docs 6e199a3e2). The fair pinned Zod audit improves 394→374 diagnostics and 389→369 unique identities, exactly 20 false TS7006 removed and zero added; two candidate runs are byte-identical. Zod remains outside cross-compiler timing because TypeScript reports zero diagnostics. Evidence: /home-lang/home/issues/671#issuecomment-5561759700

23 days ago

Correctness checkpoint #672 is complete (673a648a9, docs 307892be9). Its focused oracle is fixed, while two Zod candidate runs remain byte-identical to #671 at 374 diagnostics / 369 identities. This is documented as a negative corpus result and makes no timing claim. Evidence: /home-lang/home/issues/672#issuecomment-5561862625

23 days ago

Correctness admission #673 landed on main (a730be062, docs 4d5d3d5a9). Fair Zod 4.5.2 A/B: 374 -> 350 diagnostics, 369 -> 345 location/code identities, 24 removed and 0 added; two byte-identical ReleaseSafe runs (68.84s, 71.47s). Zod still has diagnostics, so no cross-compiler timing claim was admitted. Details: /home-lang/home/issues/673#issuecomment-5568630029

23 days ago

#687 is complete on origin/main: code 901c0d0ec, docs ca6870a79.

On the unchanged pinned Zod 4.5.2 graph, Home improves 350 → 348 diagnostics and 345 → 343 unique identities, with exactly two TS7006 identities removed and zero added. The fair three-engine Promise-union oracle is clean for all valid cases and preserves the exact one-TS2322 negative control. Program 205/205 and checker 4,365/4,365 pass, along with ReleaseSafe and ReleaseFast builds.

The remaining four core/parse.ts TS7006 sites are now isolated to qualified imported issue-array element transfer and are tracked in #688.

23 days ago

Published fix: 48ef397 (refs #416; fixes #728), authored by glennmichael123 gtorregosa@gmail.com, without coauthors.

The predicate, large-predicate, and destructuring negative controls now accept only normal diagnostic exits 1 or 2 with the exact diagnostic multiset. Matching diagnostics followed by a crash or timeout no longer admit a compiler to timing.

Verification: all 96 benchmark harness tests pass, including 63 simulated admission decisions in the new matrix. README and TS_PERFORMANCE.md document the result as untimed, preserving the historical timing tables without claiming fresh validation or a speedup.

Local baseline preparation remains incomplete: a single-job ReleaseFast home-tsc build was stopped by the unchanged 3072 MB ceiling at a reported 3101 MB tree footprint. The old binary was not used to publish current performance numbers. Pinned competitor installs and Hyperfine are also absent on this checkout. Full benchmark leadership remains open.

23 days ago

Current-source execution is tracked in #732.

The local one-job ReleaseFast build was stopped by the repository supervisor at 3,588 MB under a 3,584 MB ceiling, then at 3,854 MB under a final 3,840 MB ceiling. The host remained healthy; no higher ceiling was attempted. The existing home-tsc binary is stale and was not benchmarked.

The repository's existing TypeScript Frontend Benchmark workflow was dispatched against current main, but GitHub rejected it before creating a run with HTTP 422: “Actions has been disabled for this repository.” Pinned competitors and Hyperfine are ready locally. No new performance result exists, so README and TS_PERFORMANCE timing tables remain unchanged.

#732 defines the fair recovery boundary: current ReleaseFast build, unchanged schema-3 admission, complete 30-round interleaved suite, retained provenance/raw samples, then documentation updates from that evidence.

23 days ago

Published build capacity and benchmark documentation to origin/main as glennmichael123 <gtorregosa@gmail.com>, without coauthors:

  • 11a38aa95 adds -Dhome-tsc-strip=true, uses it in the benchmark workflow and documented reproduction, and retains ReleaseFast semantics. The current compiler built with one job at 2,942 MB peak supervised tree footprint, down from the unstripped attempts that crossed 3,584 MB and 3,840 MB ceilings.
  • aa60cdbdf publishes focused result 20260911T033015Z in TS_PERFORMANCE.md and the README.

The focused run admitted unchanged checkjs_jsdoc and type_predicates_large, used 30 fresh processes after three warmups, rotated compiler order, retained all 180 samples, and verified artifact provenance unchanged before admission and after measurement. Mac14,9, 16 GiB, 10 cores, macOS 26.3.1 arm64. Benchmark peak was 452 MB.

WorkloadTypeScript 6.0.3Native TypeScript 7.0.2Home 0.1.0Home lead
checkjs_jsdoc270.0 ± 54.1 ms69.2 ± 3.7 ms39.0 ± 1.4 ms1.77×
type_predicates_large1257.2 ± 104.6 ms421.8 ± 20.1 ms288.0 ± 15.3 ms1.46×

This focused confirmation supplements the prior full 20-workload snapshot. It is not a cross-platform or full-suite claim. #733 tracks the narrower large-predicate scaling lead. #732 remains open because GitHub Actions is disabled and the Linux x64 full-suite runner still cannot be dispatched.

23 days ago

Published ef0174c05 directly to origin/main as Chris Breuer, without coauthors, after rebasing on the latest main.

All 20 detailed table rows match the generated verified report exactly. The archive has 600 byte-identical raw round files, 3,000 retained samples, 140 successful admission records, and 603 verified payload checksums. Home's measured result is 1/20 lowest medians across all five admitted compilers, and 11/20 faster than direct native TypeScript 7. No older host, launcher, or competitor result is merged into this table.

The next source-level optimization is tracked in #839, starting with the largest relative gap, reexport_graph (2.24× slower than Bun). The full goal remains open: #548 production admission, additional platforms, C++ repository selection under #838, and all remaining five-compiler losses still require work.

23 days ago

Published two small conventional commits directly to origin/main, as Chris Breuer and without coauthors:

  • Source: b18f19203, perf(ts): reuse bound export owners across name queries (#839).
  • Evidence/docs: 3318885fb, docs(ts): publish export-owner reuse measurements (#839).

Detailed current snapshot and same-parent acceptance and brief README table are updated. All 20 detailed rows and all 10 README rows match the verified generated report exactly.

The independent unchanged re-export confirmation improves 20.178 → 17.430 ms, 1.158×, 27/30 paired wins; paired mean saving 95% t interval 1.565–3.403 ms. The diagnostic same-generator 4096-leaf confirmation improves 1.701 → 1.538 s, 10/10 pairs, interval 131.280–226.124 ms. All samples and reversed command order are retained. Full Program 228, checker 4473, CLI 74, and harness 128 tests pass on the measured candidate. Pinned unmodified 106-file Zod has identical complete 196 TS + 3 HM9002 diagnostic identity multisets, with no added or removed diagnostics; this is stability, not production admission.

The complete five-compiler checkpoint retains 600 raw rounds / 3000 samples / 140 successful admissions / 603 verified checksums. Home leads 1/20, beats direct native TS 7 on 12/20, and still trails Bun on re-exports by 1.94×. The frozen measured source is precisely ef0174c05 plus the retained source patch; intervening compiler changes present after rebase are not assigned these timings.

  • Matrix archive, SHA-256 20d645283831bd360212267cbc27be7c54590c83fda2e9a02b6af6316d1e6672.
  • Paired archive, 4902 verified checksums, SHA-256 2c59c9f4781daae166031d43af2ece2d17e9180083e4b6a15eace89b9d37bd9a; all 266 pair rounds, full scale inputs, exact patch/scripts and semantic logs retained.

Documentation-only Pickier and git diff --check pass; the frozen candidate's repository-wide Pickier run has pre-existing 22074 findings, not a clean pass. A fresh published-tip repository-wide run is in progress.

#839 remains open. Code inspection has identified the next repeated-work site: each export-facts request constructs fresh origin queries, and recursive facts requests reopen and bind owners despite the adapter's retained query. The next candidate will test reuse of immutable owners and complete origin-query work without changing the fact traversal or introducing special cases. Any further source change requires a new exact-parent A/B and full semantic gates. #416, #838 and #548 remain open for competitor gaps, platform/C++ coverage and full production admission.

23 days ago

Published source 69c3d28ee and evidence/docs eaaddf213 directly to origin/main, as Chris Breuer, without coauthors. Both use conventional, #839-linked commit subjects; the worktree is clean.

Current detailed snapshot and the brief README table are updated. All 20 detailed rows and all 10 README rows match the verified generated report exactly. Documentation-only Pickier and git diff --check pass; full repository Pickier reports its 22074 findings, not a clean pass.

Performance and semantic acceptance

  • Exact parent 3318885fb; candidate source exactly 69c3d28ee, with no intervening upstream source in the rebase.
  • Official independent confirmation: 32.665 -> 24.885 ms, 1.313x, 25/30 paired wins; paired mean saving 95% t interval +2.516 to +13.013 ms.
  • Same-generator 4096-leaf confirmation: 2.503 -> 1.950 s, 1.283x, 9/10 wins; interval +255.781 to +710.265 ms. Official 64-leaf workload is unchanged.
  • Every screen/confirmation observation is retained. All 20 families were screened; three >3%-slower medians triggered independent 30-pair rechecks. Those median slowdowns did not reproduce, but startup remains 0.7% slower in its recheck (9/30 wins, saving CI -0.323 to +0.007 ms). Overlap is not equivalence or proof of no regression.
  • Full Program 230/230, checker 4483/4483, core CLI 74/74, entrypoint 33/33, harness 128/128 pass. No named-test filters/source exclusions; native test symbols are stripped under the unchanged guard.
  • Full unmodified pinned Zod: identical complete 196 TS + 3 HM9002 diagnostic identity multisets, zero additions/removals. Observed footprint is 887 MiB parent / 991 MiB candidate, an explicit memory tradeoff. This is regression stability, not production admission.

Fresh five-compiler result

20261008T031844Z: 140 successful admissions / 600 raw rounds / 3000 retained samples / 603 verified payload checksums, with unchanged provenance. Home leads 1/20 and beats direct native TS 7 on 12/20; Bun leads 18, Rust leads imports. Re-exports remain 1.99x slower than Bun. The largest relative loss in this run is CommonJS, 2.35x slower. No earlier host/run/competitor timing is merged into this table or attributed as a patch A/B.

  • Full matrix archive, SHA-256 50ea6212fdf1de7b6884a83d298c3a654a023ad1712e877a53163e70107f90ce.
  • Paired archive: 356 raw pair rounds / 5002 verified checksums, exact patch/scripts, complete admissions, all scale inputs and semantic logs; SHA-256 6f7abd669e0c0ad3692e7f96117bf78c18f0883c05586bd4d2cf8f861d1ade3e.
  • Candidate executable SHA-256 4b4af24fdb57dcfdba69de49a460014a1800cacdda7164a4fc8614e727e9ec2d.

#839 and the overall #416 goal remain open; #838 still needs canonical C++ selection/coverage and #548 full production admission. Code inspection identifies remaining general repeated work in recursive export-facts preparation, which still opens/binds nested owners independently of the retained query. That is a next source-level investigation, not an implemented or measured speed claim.

Execution headroom fluctuated again after publication (about 481 MiB free, below the unchanged admission/continuation disk floors). The successful completed runs are not relabeled as failed, and no new heavy work will be started below the guard. #732 remains the execution-capacity tracker. No resource ceiling/floor was relaxed or unrelated file/job altered.

23 days ago

Published source 30d3824da and evidence/docs a444cf021 directly to origin/main, as Chris Breuer, without coauthors. Both are conventional, issue-linked commits. The worktree is clean.

Current detailed snapshot and brief README table are updated. All 20 detailed rows and 10 README rows match the verified report exactly. Documentation-only Pickier/diff checks pass; repository Pickier retains 22082 findings, not a clean pass.

  • Same-parent independent official confirmation: 25.546 -> 20.730 ms, 1.232x, 25/30 wins; saving 95% t interval +2.446 to +9.779 ms. Unchanged-generator scale: 2.888 -> 2.351 s, 1.228x, 10/10, interval +375.313 to +791.154 ms.
  • The adverse initial overload screen (34.391 -> 42.957 ms, 2/10, interval -9.375 to -0.516 ms) is retained. All ten >3%-slower-median families receive independent 30-pair rechecks. Overloads are flat in that recheck; no recheck has an interval wholly below zero. Overlap is not equivalence. CommonJS remains 0.7% slower in its recheck and is explicitly documented.
  • Full Program 231/231, checker 4483/4483, core CLI 74/74, entrypoint 33/33, harness 128/128 pass. Unchanged checker artifact executes from cache; no named filters or source exclusions.
  • Pinned unmodified 106-file Zod has equal complete 196 TS + 3 HM9002 identity multisets, zero additions/removals. Observed footprints 1087/936 MiB (parent/candidate) are not a universal resource claim or production admission.
  • Fresh 20261008T042639Z: 140 admissions / 600 raw rounds / 3000 retained samples / 603 verified checksums, unchanged provenance. Home leads 2/20 (startup, overload_resolution) and beats direct native TS 7 on 15/20. Bun leads 17; Rust leads imports. Counts/margins are descriptive, not significance or cross-run causal claims. Re-exports still trail Bun by 1.27x, so #839 remains open.
  • Matrix archive: SHA-256 ed253feb8650bcb68995ba7c21ad83c07c2ed6652fc4747a879c00f35c60c8fd.
  • Paired archive: 566 byte-identical pair rounds / 5209 verified checksums, all admissions/observations, full scale inputs, exact patch/scripts and semantic logs; SHA-256 37199143215b6a03705bf3cba9975de232c43c8f4e0e9693ea0b8699a80e53bb.

No guard ceiling/floor is changed and no unrelated file/job is altered. Parent eaaddf2 has exactly the same compiler inputs as 69c3d28 (only documentation/evidence differ); frozen parent reuse is recorded, not mislabeled as a fresh compile. Candidate SHA-256: 92338a9715ef01c3bf7e7238f980e9df72e856340f6684daabf98924ceea4960.

The inherited eight-level fact cutoff is unchanged and explicitly outstanding in #843; storage reuse does not certify unbounded correctness. #416's full goal, #838 C++ selection/platform coverage, and #548 production admission also remain open. The next correctness investigation is a cycle-safe complete fact traversal under #843, alongside remaining performance gaps. No overall completion claim.

23 days ago

Published three small conventional commits directly to origin/main as Chris, no coauthors: 4e8ee86 fixes ambient enum option/access diagnostics (#844); 929d46a removes the export-fact depth cutoff with a cycle-safe retained-owner worklist (#843); aed1dad publishes detailed docs, a brief README cost table and verified raw evidence. Complete source suites passed (checker 4493, driver 199, Program 237, CLI 74, entrypoint 33), harness 128. Thirty original TS oracle cases exactly match; a new ordinary .ts default-import oracle still fails and is driven by open #845. Zod identities unchanged at 196 TS + 3 HM9002, not production admission. Exact-parent graph/scale confirmation medians are 2.9%/1.5% slower with intervals spanning zero; no speedup or equivalence claim. Large-predicate 3.1% screen warning and 0.5% slower independent recheck both retained. Archive retains 592 pair rounds, 448 passing admissions, 6206 verified checksums. Latest five-compiler matrix remains only 2/20 Home leads, so the leadership goal is not complete. Next: real module/default/interop oracle coverage under #845 and broader #843/#844 acceptance; continue logical performance work under #839 after correctness gates. Docs: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#complete-export-fact-traversal-and-option-diagnostics-2026-10-08-utc

23 days ago

Published two small conventional issue-linked commits directly to origin/main as Chris, no coauthors: 206cdf1 fixes default imports using retained module/source facts and actual JS admission (#845/#846); cde7cd3 publishes docs, README table and verified evidence. All final suites pass: checker 4501, Program 238, CLI 74, entrypoint 35, driver 199, harness 128. Native TS7 oracle 105/105, shared-config TS6 86/86; all 19 option-dialect cases retained explicitly, with native config locations now matching upstream #847. Exact parent b6e34fc Zod has identical 195 TS + 3 HM9002 identities, zero changes; not production admission. Cost confirmation inconclusive (graph 0.8% slower, scale 0.8% faster); retained large-predicate warning 3.5% slower and independent 0.9% slower recheck with zero-spanning interval. Archive 296 pair rounds, 224 admissions, 6271 checksums. Full repository lint still fails; targeted edited docs pass after correcting the earlier Markdown issue. Latest expanded five-compiler matrix remains 2/20 Home leads, so the full leadership goal is not complete. Next logical work remains closing benchmark gaps (#839), broader module/JS acceptance (#845/#846), production correctness (#548), and expanded platform/compiler coverage (#838). Report: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#default-module-owner-correctness-and-cost-checkpoint-2026-10-08-utc

23 days ago

Published #848 rejection evidence in 686089a after retaining tests in 773ca88, both conventional main commits as Chris without coauthors. Two general CommonJS path-index variants improved the local row ~5% but independently regressed large predicates, so neither compiler change was accepted. Restored original implementation; source-pinned restored native image exactly matched parent. README now has a brief tradeoff table linked to detailed rejection docs. Verified archives preserve all 686 paired rounds / 392 admissions, 56 profile admissions and 7031 checksums, plus the entire unaccepted five-compiler matrix 20261008T140417Z (600 rounds / 3000 samples, 140 admissions, 603 checksums). That prototype leads only 1/20 and is not the accepted current snapshot; prior accepted matrix remains dated separately. Goal remains incomplete. Next: general require/member/path lookup optimization with evidence that avoids the observed large-predicate tradeoff, continuing #848/#839 and broader correctness/platform/compiler scope.

23 days ago

Verified publication correction: docs commit 686089a was not pushed; main advanced and rejected it. Clean rebase and normal retry succeeded as 9ccd62c, with remote main verified and no force push/coauthors. Both #848 rejection archives, detailed docs and brief README table are now genuinely published. Source-pinned rejected experiments are not relabeled as results from the newly integrated library/config/substitution changes. Goal remains active and benchmark leadership remains unproven.

23 days ago

Child issue #849 is complete on main in 74b181394. The checker now groups static require/import-equals candidates by local name inside the existing declaration-index lifetime, with the full ordered scanner retained on allocation failure.

Integrated checker: 4,521/4,521. Exact-parent evidence retains 68 semantic admissions, full Zod identity, all raw rounds, and seven independent regression rechecks whose intervals span zero. The official and 1,024-family timing intervals are inconclusive; the independent 4,096-family run measured a +23.185 to +209.313 ms paired mean-saving interval. Full report and checksum-covered archive are linked from the README. Broader performance/parity work under #416 remains open.

23 days ago

Reviewed the landed #848/#849 implementations on main at 30ab18c. The grouped-require evidence archive verifies its published SHA-256 and every one of its 5,701 payload checksums. My earlier local #849 prototype remains preserved and uncommitted; its official and scale confirmation intervals crossed zero, so it is not promoted as a speedup or applied over the accepted implementation. Next: build and profile the current integrated source, preserving the 3,840 MB guard and shared machine lock, then select a remaining hotspot from current evidence. A new cross-compiler ranking is not claimed; #838 still owns the pinned matrix/C++ scope.

23 days ago

Completed #850 in small Chris-authored, conventional, no-coauthor commits on origin/main: source 00a9dcf and final docs/evidence 211d28c. Complete per-pass global reference facts preserve scanner semantics and allocation-failure behavior, with no persistent File/Checker state or language-rule shortcut. Frozen exact-parent official CommonJS confirmation has a 2.9% lower median; scale4096 has a 12.6% lower median, with positive paired mean-saving intervals. Scale1024 confirmation and the independent large-predicate recheck remain inconclusive, and all adverse observations are retained. Integrated source passes checker4527, Program247, supported build, 32 admissions, 116 semantic cases per four binaries, and unchanged full Zod198 diagnostic messages. README/report and both checksum-covered archives are published; timings remain explicitly frozen-parent, not relabeled after independent #842 integration. #416 is NOT complete: current accepted five-compiler ranking remains the older 2/20 checkpoint, #838 needs a fresh fully pinned matrix/platform scope, and #548 still has 195 TS + 3 HM9002. Next is the fresh matrix and its remaining measured gaps.

23 days ago

Fresh complete matrix published on origin/main in ac8af9c, as Chris without coauthors. Result20261008T202953Z measures landed compiler00a9dcf8f/metadata-source211d28ce3, native c16c8ca. Every one of 140 admissions, 600 original rotating-order rounds/3000 retained samples and 603 archive checksums verifies unchanged provenance. README10 rows and detailed20 rows match recomputed raw medians; the 12-checksum context archive preserves runner/guard/source proof and passing128-test harness log. Home currently leads1/20 (startup), ahead of nativeTS7 on11/20; Bun leads18, Rust imports. This replaces the old2/20 current ranking honestly, not as a causal patch regression. Largest current gaps: checkedJS/JSDoc2.19x, CommonJS2.04x, nullsafe1.97x, interfaces1.95x, TSX1.93x slower. C++ remains excluded for semantic failure, platform scope and Zod195TS+3HM9002 remain open. The full leadership goal is not achieved. The next scoped investigation targets Resolver.resolve allocating an owned concatenated key even on cache hits, preserving exact keys, trace/ambiguity and importer-condition semantics.

23 days ago

#851 adapted streaming resolver-key lookup is rejected after fair exact-parent confirmation: official reexports and both generated scales have wholly negative mean-saving intervals despite zero cache-hit allocations and complete semantic gates. No rejected compiler code landed. Small Chris/no-coauthor commits db28b2e and dce5796 retain general controls plus the complete rejection report/README table/raw archive. All452 rounds,256 admissions and13078 checksums verify; all adverse/inconclusive observations remain. Restored native is byte-identical to c16c8ca, so current accepted matrix remains Home1/20, not a newly improved ranking. #851 remains open; next work needs a different design with measured cost, or profiling the largest current checked-JS/CommonJS gaps. No workarounds, source-name shortcuts, hash edits, sample filtering or guard expansion were used.

23 days ago

Scoped #852 fairness gap fixed and evidence published in3491cdb45/6004a26 as Chris, no coauthors. CheckedJS now has a direct15-error gate at first/middle/last families; all five compilers pass isolated/combined controls and the fresh full protocol4 matrix145 admissions/600 rounds/3000 samples. CurrentHome1/20 first, ahead of nativeGo12/20; no universal lead or causal cross-run claim. README10/full docs20 rows match raw data. Profile of accepted compiler points to declaration-space and late checkSourceFile work, with exact instruction/source/input fingerprints and58 semantic image admissions. #853 tracks the next source-level investigation. Limits remain3840 MB/shared lock/disk floors. #416 remains active; platform/C++ scope and195TS+3HM9002 production gap remain unresolved.

23 days ago

Another small measured source chunk is pushed directly to main: class/interface modifier-merge index bbabc2f (#853), with docs/evidence/README commit b513c85, both sole Chris author/committer and no coauthors. Independent exact-parent confirmation supports about 1% lower medians for class hierarchy and 512-family JSDoc checking. All 442 paired rounds, 660 admissions, adverse large batch and inconclusive results are retained; the pooled large interval is positive but five-batch variation spans zero. Full checker4531 and harness136 pass, with unchanged Zod198 diagnostics. Detailed tables/raw archive: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#classinterface-modifier-merge-index-2026-10-08-utc . This A/B does NOT replace the latest full five-compiler matrix: Home still first 1/20, ahead of native TS7 12/20, with remaining C++/platform/Zod gaps. #853 remains open for the separately mapped whole-file JSDoc class-owner scan. The all-benchmark leadership goal remains incomplete.

23 days ago

Pushed a larger source-derived JSDoc performance chunk to main: ac34883 (#853), with complete docs/README/evidence in 9629578. Both are Chris-only conventional commits without coauthors. Exact-parent independent confirmation: official checked JS 29.662 -> 28.097 ms (5.3% lower), 512 families157.129 ->131.756 ms (16.1% lower), all five 8192 batches18.790 ->12.398 s (34.0% lower), all30 pairs favor the candidate in each scope. Pooled and between-batch large intervals are positive; all442 rounds/660 admissions and adverse-but-inconclusive risk results remain. Fullchecker4536 andharness136 pass; Zod198 diagnostics unchanged. Full report/raw evidence: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#class-local-typedef-owner-index-2026-10-09-utc . A fresh five-compiler matrix is starting, not inferred from A/Bs. Until that audit, the latest complete matrix remains Home1/20 and ahead of native TS7 12/20; C++/platform/Zod and all-benchmark leadership remain incomplete.

23 days ago

Published the fresh landed-owner five-compiler matrix and current-source profile in 4bbbd19 (Chris-only conventional commit, no coauthors, pushed to main). Result20261009T004232Z uses compilerac3488350/nativefb77a18e, validation4, all145 admissions /600 original rounds /3000 samples and603 verified archive checksums. Home still leads1/20 and beats nativeTS7 on11/20; Bun18 leaders, Rustimports. CheckedJS2.10x, interface/CommonJS2.02x, TSX1.98x and nullsafe1.97x remain gaps. Cross-run counts are descriptive, not causal regression/equivalence claims; earlier matrices and all A/Bs remain dated history. README10 rows/full20 rows match unrounded raw medians/ratios. Profile62 admissions and identical instruction sections support a new mapped repeated full-HIR nearest-prior var/let/const query (#854), not whole-run CPU percentages. Full report/evidence: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md . Overall goal remains incomplete, with C++/platform/Zod gaps unchanged.

23 days ago

Pushed another measured compiler chunk and its complete evidence: af5fb32 / b9e6d25 (#854), Chris-only conventional main commits without coauthors. NodeId-only nearest-prior value candidates reduce independently confirmed JSDoc medians3.1% officially,9.9% at512 families,29.8% at8192; pooled and five-batch large intervals positive andall30 large pairs favor candidate. All472 rounds/660 admissions retained, including deep_types warning/extra recheck and inconclusive adverse-risk medians. Fullchecker4542/harness136 andallintegration modules pass; Zod198 unchanged. READMEtables/full docs/raw1585-checksum archive: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#nearest-prior-value-declaration-index-2026-10-09-utc . No competitor ranking inferred: latest published whole matrix predates this change and remainsHome1/20, nativeGo11/20. Remaining C++/platform/Zod/performance gaps and all-benchmark leadership remain incomplete.

23 days ago

Published refreshed nearest-prior matrix/profile in 5ea87f0, Chris-only conventional main commit without coauthors. Full result20261009T033439Z (sourceb9e6d2591/compileraf5fb320a/native69836df6) passes145 schema4 admissions and retains600 rounds/3000 samples with603 verified matrix checksums; all20 detailed/10 README rows match raw unrounded medians/ratios. Home remains1/20 and ahead of nativeTS7 11/20; Bun18, Rustimports. Current JSDoc gap1.95x, CommonJS1.98x, nullsafe1.96x, TSX1.90x and interfaces1.88x remain. These cross-run matrix counts are descriptive, not causal/equivalence verdicts. New diagnostic-only62-admission instruction-identical image/raw824/817-observation early/middle samples identify repeated virtual-section prefix and require-binding work, not whole-run percentages. Detailed tables/raw archives: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md . All-benchmark leadership, C++/platform/Zod objectives remain incomplete.

23 days ago

New scoped performance checkpoint landed on main as Chris-only commits 30330c1 (source) and 71fa7db (docs/evidence), both linked to #854. Complete virtual-section source facts preserve exact semantics and full scalar OOM fallback. Independent checked-JS medians improve 4.0% at 512 families and 15.1% at 8,192, with all 30 large pairs faster and positive pooled/five-batch intervals. All 502 paired rounds, 660 admissions, full module/harness tests and unchanged pinned Zod diagnostics are documented with 1,617 verified payload checksums. Official performance is inconclusive; recursive generics retains a 1.5%-slower independent median and nearly negative interval, prominently documented as unresolved. Latest published competitor matrix is still Home 1/20 leads, ahead of native TS7 11/20; refreshing landed-source matrix next. C++ admission, other-platform coverage and Zod production admission remain unresolved. https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#virtual-section-prefix-facts-2026-10-09-utc

23 days ago

Published the fresh five-compiler matrix and current-source profile in Chris-only main commit 484ad69 (source optimization 30330c1, A/B evidence 71fa7db). All 145 admissions and 3,000 samples verify with unchanged pins. Home still leads 1/20 and beats native TS7 11/20; Bun leads 18 and Rust leads imports. Checked-JS/CommonJS gaps are 2.04x/2.03x versus fastest competitors. Separate exact-parent scaling gains remain 4.0%/15.1%, with the unresolved recursive-generics warning retained. Complete source-owned require-binding facts are the next measured work item under #854. C++ admission, platform coverage, Zod production admission and universal leadership remain open. README/table/raw checksum evidence: https://github.com/home-lang/home/blob/main/docs/docs/TS_PERFORMANCE.md#landed-virtual-section-matrix-2026-10-09-utc

23 days ago

Correctness prerequisite landed in 18fc11133: Home now computes TypeScript's effective allowJs from omitted allowJs plus checkJs, while preserving explicit false. TS6/native TS7 differential controls agree on TS2322/TS5052/TS5053, and the rebased checker passed 4,546/4,546.

This is a semantic-admission correction, not a benchmark speedup claim. It prevents future benchmark/config matrices from accidentally comparing different admitted source sets. Detailed scope and remaining work are tracked in #846.

Sign in to comment on this issue.