← Back to index
Real plan-to-plan comparison · written 2026-09-18

Plan Comparison Table

All 497 real tensors, all 7 real plans side by side: Production, Plan A/B/C (original, real default --pareto meaningful + --hessian-weight-strength 2.0), and A2/B2/C2 (same real settings, corrected: --pareto none + --hessian-weight-strength 0). Spread is now the max-min bits across all 7. Raw Hessian/KL signal data kept at the end as reference only.

namelayercomponentProd bitsA bitsB bitsC bitsA2(nw) bitsB2(nw) bitsC2(nw) bitsspreadProd hessian floorA hessian floorB hessian floorC hessian floorA2(nw) hessian floorB2(nw) hessian floorC2(nw) hessian floorProd early qkv floorA early qkv floorB early qkv floorC early qkv floorA2(nw) early qkv floorB2(nw) early qkv floorC2(nw) early qkv floorProd late attn floorA late attn floorB late attn floorC late attn floorA2(nw) late attn floorB2(nw) late attn floorC2(nw) late attn floorparam counthess scorehess rankkl4kl rank

Side-by-side: every real parameter, all 7 plans

Plan A/B/C used the real default --pareto meaningful and --hessian-weight-strength 2.0. Plan A2/B2/C2 are the identical real commands corrected with --pareto none and --hessian-weight-strength 0 (2026-09-18 finding).

ParameterProdABCA2(nw)B2(nw)C2(nw)
Achieved BPW5.0285525.0285715.0285745.0285745.0284435.0285685.028568
--paretomeaningfulmeaningfulmeaningfulmeaningfulnonenonenone
--hessian-weight-strength(n/a)2.02.02.00.00.00.0
--hessian-primarynoyesyesyesyesyesyes
Hessian floor tensors(none)616061616161
Late-attn floor tensors767676076760
Early-QKV floor tensors4804800480
Raw Sigma isolated KL37.4550.51753.11452.2538.88950.36150.093
OptiQ-weighted Sigma KL57.136388.189412.61411.39758.575221.598221.33

Bit distribution

ParameterProdABCA2(nw)B2(nw)C2(nw)
Q4236291268309221262298
Q592114121838011479
Q613294333353733
Q83202321192019
Q161534342511426468

Note: Plan C2 was re-run (2026-09-18) with the correct --hessian-weight-strength 0 -- the file now correctly matches A2/B2 (weighted ΣKL 221.3, consistent with the other clean strength=0 runs). Raw KL remains the one to trust for any real comparison regardless -- weighted ΣKL is dominated by a handful of tensors where --protection-multiplier (100×, boundary/lm_head only) and Hessian strength compound multiplicatively; it barely reflects the other ~492 tensors even when clean. Full mechanism: MILP_AWARE_HESSIAN_GUIDE.html.

Author: Hakim Ghelab, VegaLaboratories LTD · Data: full_tensor_comparison_all_plans.csv, all 497 rows, no filtering.