MOO-First Experiments
Systematic experiments using Multi-Objective Optimization to validate, refine, or bound framework claims. Each experiment produces honest results regardless of outcome.
Executive Summary
Sod: 0.37% vs Van Leer
Meta ~1st order
R^2 0.71 to 0.44
Meta kills attractor
9 counterexamples
0/1000 unitary
H0 criterion unsatisfiable
Methodology: Build on existing result files and scripts. The method differs per experiment (see Methodology below). Document honest outcomes for each experiment.
EXP-1: Shock Tube CFD
TIE ON SODVisual engineering demonstration on the Sod shock tube. Tests meta-calculus flux limiting against classical limiters (minmod, superbee, Van Leer, MC).
CORRECTED: What Really Happened
- ~ Sod: best fixed scheme (Meta-Adaptive) is 0.37% below Van Leer in L2: a tie
- ~ Sod dual MOO: 10 of 30 pymoo NSGA-II front points Pareto-dominate Van Leer (one unseeded run, best L2 gain 0.65%)
- ~ Shu-Osher (SSP-RK2 re-run 2026-10-07): MOO-tuned L2 0.1563 vs Van Leer 0.1578, 1.0% over the best standard limiter, seed 42, in-sample, limiter k kept in the TVD range [0, 1] (results/shu_osher_moo.json). The earlier 5.4% over minmod came from an unstable forward-Euler integrator and is retracted.
- ~ 5-seed, 15-generation re-run (SSP-RK2): best L2 0.1565 +/- 0.0001, 3.5% below minmod and 0.9% below Van Leer, in-sample (results/multi_seed_moo_results.json; the earlier 12.1% came from the retracted integrator)
Critical Failure
- - Parameters are problem-specific: artifact verdict PROBLEM_SPECIFIC (results/cross_validation_results.json)
- - Sod params on Shu-Osher: L2 0.1304 vs superbee 0.1207 (8.0% higher); transfer change vs Shu-Osher-tuned params -3.27% (the earlier figure from the retracted solver is superseded)
- - Only 1D benchmarks tested
- - Real CFD much more complex
results/shock_tube_dual_moo.json, results/shu_osher_moo.json | Script: simulations/shock_tube_moo.py, simulations/shu_osher_moo.pyCFD results page →EXP-2: Convergence Order Verification
CORRECTED 2026-06-12Lax equivalence test on 1D linear advection. Measures convergence order via log-log error analysis.
CORRECTED: What Really Happened
- + Classical 2nd order verified: Central-RK4 = 1.99, Lax-Wendroff = 1.98
- + Meta-k schemes measure 0.84-0.95: ~1st order, rising mildly with k
- - "Bigeometric = 2nd order" retracted: that scheme was central difference in disguise (D_BG inverts back to u')
- + All fits have R^2 >= 0.994 (the measurements are clean; the old labels were not)
Critical Failure
- - Only 1D linear advection tested
- - Gaussian pulse (smooth IC)
- - Short time (T = 0.5)
- - No shock/discontinuity tests
results/convergence_order_verification.json | Script: simulations/convergence_order_verification.pyEXP-5: Spectral Gap Boundary
REFUTEDA guarded 1000-case grid search retained 88 normal compositions and refused 912 non-normal cases.
What Still Holds
- + 79/88 valid normal samples satisfy the proposed bound
- + 3 distinct small baseline compositions satisfy it (the file lists 5; the others repeat a case)
- + The guarded search is reproducible
Counterexamples Found
- - 9 valid cases violate the proposed bound
- - 5 Dirichlet and 4 periodic counterexamples
- - Minimum valid gap ratio: 0.2127
- - This refutes the general claim; it is not a theorem
results/spectral_gap_boundary_moo.json | Script: simulations/spectral_gap_boundary_moo.pyEXP-3: k(L) Bound Sensitivity
CONTROL FAILA fresh seed-42 rerun reproduces R^2=0.7096 only when the optimizer receives scale-specific k bounds that encode the same trend. With common bounds at every scale, R^2 falls to 0.4370 and the model's linear-pattern test fails.
Encoded-bounds run
- R^2 = 0.7096
- k = -0.0137 log10(L) + 0.1585
- 8 synthetic scale models
- Not independent physical evidence
Common-bounds control
- R^2 = 0.4370
- 7 of 8 selected k~0
- Linear-pattern test: failed
- Archived lookup claim: not validated
results/multiscale_moo_results.json and results/multiscale_common_bounds_control.json | Script: meta_calculus/multiscale_moo.py |full auditEXP-4: Lorenz Chaos Preservation
NEGATIVETests whether meta-calculus can preserve Lorenz attractor geometry longer than classical RK4. Measures time inside a bounding box, energy drift, and a Lyapunov exponent estimate.
What This Shows
- - meta-0.3 does not match RK4: it spirals into the fixed point (-8.49, -8.49, 27) and stays there
- - Its "100 time units" is just t_max: it never left the box because it stopped moving
- - Every other meta scheme leaves the box by t = 2.65
- - No meta scheme preserves the chaotic attractor
Honest Interpretation
- NEGATIVE: the meta schemes change the dynamics
- The Lyapunov estimator is unvalidated: it gives 0.05 for RK4 vs the known 0.906
- This bounds framework capabilities
- Not all problems benefit from meta-calculus
results/chaos_preservation_moo.json | Script: simulations/chaos_preservation_moo.pyFatal Bug: Forced Normalization Invalidated Results
The original P05 simulation had a critical bug: forced normalization after each timestep (lines 139-141). This artificially made all configurations appear unitary-preserving when they were not.
Honest result after bug fix: the historical model scanned here (historical nonunitary blend of Crank-Nicolson and a log-amplitude update, simulations/quantum_phase_moo.py at revision e06aaa4) does not preserve the norm.0/1000 of its configurations preserve norm without explicit correction. Best norm drift: 2.56e-4. This is a result about that blend, not about bigeometric evolution in general. Previous claim that "MOO discovers unitarity-preserving parameters" was INVALID.
EXP-6: Quantum Phase Diagram
CORRECTED - BUG FOUNDCORRECTED December 2025: Original P05 simulation had forced normalization bug. After the bug fix, the historical blend model (historical nonunitary blend of Crank-Nicolson and a log-amplitude update) does not preserve the norm: 0/1000 scanned configurations preserve it. MOO discovery claim was INVALID.
CORRECTED: What Really Happened
- - 0/1000 configurations preserve unitarity naturally
- - Forced normalization masked the failure (bug lines 139-141)
- - Best norm drift: 2.56e-4 in the historical blend model
- - Previous "MOO discovery" claim was INVALID
Critical Failure
- - The historical blend breaks the norm at every scanned point; this does not show that every bigeometric evolution must
- - Plain Crank-Nicolson is unitary by construction; the current simulations/quantum_phase_moo.py evolves that way and ignores k, w and p
- - All 1000 scanned (k, w, p) points break unitarity; every scanned k is nonzero (k != 0)
- - Data file: public/quantum_phase_corrected.json (corrected_results.json and the old quantum_phase_moo.json are superseded: they still record the bugged 100% unitary run)
public/quantum_phase_corrected.json | Script: simulations/quantum_phase_moo.py at revision e06aaa4 (the current script no longer produces this scan)EXP-7: Cosmology vs Real Data
INCONCLUSIVECompares one meta-calculus expansion-rate model with SH0ES, DESI, KiDS and Planck values by grid search over (k, h, Omega_m). As run, the test cannot decide whether the model resolves the tensions.
Why the Test Is Inconclusive
- - The H0 criterion needs one H0 within 2 sigma of both SH0ES (73.04 +/- 1.04) and Planck (67.4 +/- 0.5). Those intervals do not overlap, so no single H0 can pass, whatever k is.
- - Only the first 200 grid configurations were evaluated, reaching 4 k values (-0.500 to -0.342)
- - H0: 0/9 Pareto solutions pass; S8: 0/9
- - Li7: best change -28% (does not help)
What It Does and Does Not Show
- The model ratio H_meta / H_classical = 1 + k ln(1 + z) already varies with redshift (k = 0.1: 1.0000 at z = 0, 1.0693 at z = 1)
- So this run says nothing about whether a redshift- or scale-dependent model is required
- Previous "may resolve H0" claims were post-hoc fitting and stay withdrawn
- Method: grid search, not NSGA-II
results/cosmology_validation_moo.json | Script: simulations/cosmology_validation_moo.pyMethodology
Reused existing result files, MOO scripts and test infrastructure.
pymoo NSGA-II for the shock-tube, Shu-Osher and k(L) runs; grid searches for the spectral-gap boundary, quantum phase scan and cosmology; fixed-scheme comparisons for convergence and chaos.
Document both positive and negative results. Update claims accordingly.
What Changed
| Claim | Before | After |
|---|---|---|
| Shock Tube CFD | "Not implemented" | "Sod: tie. Shu-Osher MOO: 1.0% over Van Leer (one seed, in-sample; 5.4% retracted)" |
| Spectral Gap Preservation | "Baseline compositions all pass" | "General claim refuted: 9 counterexamples in 88 valid grid cases" |
| k(L) Pattern | "Constrained fit R^2=0.7096" | "CONTROL FAIL: common bounds R^2=0.4370" |
| Convergence Order | "Bigeometric = 2nd order" | "RETRACTED: that scheme was central diff in disguise; meta-k measures ~1st order (0.84-0.95)" |
| Chaos Preservation | "Not tested" | "NEGATIVE: meta-0.3 collapses to a fixed point" |
| Quantum Unitarity | "Not tested (forced normalization bug)" | "CORRECTED: 0/1000 unitary (bug fixed Dec 2025)" |
| Cosmology Tensions | "May resolve H0" | "INCONCLUSIVE: the H0 criterion cannot be met by any single H0; grid only partly evaluated" |
| HONEST-STATUS.md | Version 3.0 | Version 3.2 (updated) |
All 7 Experiments Run
Outcomes
All 7 experiments implemented with honest outcomes documented: 1 TIE (EXP-1), 1 CORRECTED (EXP-2), 1 CONTROL FAIL (EXP-3), 1 NEGATIVE (EXP-4), 1 REFUTED (EXP-5), 1 INVALID after bug fix (EXP-6), 1 INCONCLUSIVE (EXP-7).
Key Insight
Meta-calculus is a numerical tool, not a physics theory. Its measured uses are log-space reparametrization and parameter search over scheme families. The cosmology test (EXP-7) was inconclusive and does not establish what physics would be required.