ASI-Arch on the AGILLM objective · research result

DLGM #458 vs Fusion #879: one index

Two architecture candidates from ASI-Arch, seven lines of evidence, one number each. The weights and the scoring rule were fixed at 01:59 UTC on 12 November 2026, about 90 seconds into the first Fusion run and before any Fusion number had been read. Nobody independent witnessed that.

Updated 11:23, 13 Nov 2026 UTC · Fusion faithful form: 3 of 3 seeds done; low-rank form: 3 of 3

Bottom line. At full size Fusion #879 scores higher: it was ahead under your objective on 3 of 3 seeds, which is too few to prove it; in every form that could fit at 560 layers neither is ahead.

DLGM #458
74.3
index, 0 to 100, full-size forms
Fusion #879
▲ On top at full size
85.5
index, 0 to 100, full-size forms
Same index with the low-rank form, the smallest one
DLGM #458 80.6 Fusion #879 80.7neither ahead3 and 3 seeds
Same index with the gentler cut (low-rank gate, per-channel kernels kept)
DLGM #458 80.6 Fusion #879 83.0neither ahead3 and 3 seeds
Same index with the gate projection trained instead of fixed
DLGM #458 80.6 Fusion #879 83.3neither ahead3 and 3 seeds

Fusion #879 is on top of the index: 85.5 to 74.3, a lead of 11.2 points. It stays on top under 86% of 20,000 random re-weightings of the same evidence, so the result does not hinge on my choice of weights (a sensitivity check, not a statistical confidence).

Read this with the headline. The headline scores your objective with each candidate’s faithful form, as the frozen formula says. Only a cut-down form could fit at 560 layers (by parameter count; nobody has run one there). In the low-rank form, at equal steps, DLGM gains 0.117 and Fusion 0.102 nats over the live block (3 and 3 seeds), and the same index then reads DLGM 80.6, Fusion 80.7: neither ahead (a gap of 0.1 points, inside the 3-point band fixed in advance). With a gentler cut that should also fit (low-rank gate, per-channel kernels kept): DLGM 0.120, Fusion 0.112 nats (3 and 3 seeds), index DLGM 80.6, Fusion 83.0: neither ahead (a gap of 2.4 points, inside the 3-point band fixed in advance). Keeping the per-channel kernels recovers about 30% of what Fusion lost in the low-rank form, on average. That points at the full-width gate, the part too large to train at width 8192, as where its full-size lead comes from. With three seeds that share is rough, and these runs do not isolate the cause. With the gate projection trained instead of fixed: DLGM 0.117, Fusion 0.112 nats (3 and 3 seeds), index DLGM 80.6, Fusion 83.3: neither ahead (a gap of 2.8 points, inside the 3-point band fixed in advance).

The seven lines of evidence

Each line gives the better candidate 100 points and the other its share of that gain over the shared baseline. Hover a bar for the raw numbers; the table below has all of them.

DLGM #458Fusion #879
Your objective, same number of training steps
weight 35%
DLGM82
Fusion100
Your objective, long context
weight 5%
DLGM100
Fusion94
Your objective, same simulator box time
weight 10%
DLGM0
Fusion0
Your matched small-model run (v65 R6)
weight 15%
DLGM100
Fusion81
ASI-Arch paper: benchmark tasks
weight 15%
DLGM71
Fusion97
ASI-Arch paper: training loss
weight 10%
DLGM100
Fusion91
Serving readiness
weight 10%
DLGM50
Fusion100

What moved the result

Index points each line adds to one side (its weight times the score gap). Bars to the left favour DLGM #458, bars to the right favour Fusion #879.

Your objective, same number of training steps
6.3 to Fusion
Serving readiness
5.0 to Fusion
ASI-Arch paper: benchmark tasks
4.0 to Fusion
Your matched small-model run (v65 R6)
2.9 to DLGM
ASI-Arch paper: training loss
0.9 to DLGM
Your objective, long context
0.3 to DLGM
Your objective, same simulator box time
level

All the numbers

EvidenceWeightDLGMFusionGain over the shared baseline
Your objective, same number of training steps
Held-out loss after 1,200 steps in the AGILLM-objective simulator (0.6 AR + 0.2 SAT + 0.2 NAT), gain over the live block. Faithful form, all complete seeds.
35%81.9100.0simulator, faithful form: DLGM +0.1108, Fusion +0.1352 nats (3 and 3 seeds)
Your objective, long context
What 4x more context does to the loss (1,024 tokens against 256) at step 1,200, relative to the live block. Faithful form.
5%100.093.9simulator, faithful form: DLGM +0.2495, Fusion +0.2343 nats (3 and 3 seeds)
Your objective, same simulator box time
The site's equal-time method (step cost = 0.75 x bytes streamed + 0.25 x measured ms per step, against the base run of the same day), gain over the live block. Low-rank form, the one that fits at full scale.
10%0.00.0simulator, low-rank form: DLGM -0.0470, Fusion -0.1505 nats (3 and 3 seeds)
Your matched small-model run (v65 R6)
Held-out cross-entropy gain over the width-96 Transformer at an equal 120 training-CPU-seconds, about 350k parameters, 3 paired seeds; WikiText and FineWeb scored separately and averaged.
15%100.081.0wikitext: DLGM +0.0677, Fusion +0.0587 nats per byte; fineweb: DLGM +0.0847, Fusion +0.0637 nats per byte
ASI-Arch paper: benchmark tasks
7-task average, gain over the Gated DeltaNet baseline; the 20M and 340M runs scored separately and averaged. Single runs.
15%70.697.320M parameters: DLGM +1.14, Fusion +2.77 accuracy points; 340M parameters: DLGM +2.03, Fusion +1.92 accuracy points
ASI-Arch paper: training loss
Final training loss, gain over the Gated DeltaNet baseline; the 20M and 340M runs scored separately and averaged. Single runs.
10%100.090.620M parameters: DLGM +0.1778, Fusion +0.1445 nats; 340M parameters: DLGM +0.0721, Fusion +0.0720 nats
Serving readiness
Rubric: 100 = an exact incremental cache verified against full recompute on trained checkpoints; 50 = a cache that reproduces the same tokens but failed the exact-match gate; 0 = none.
10%50.0100.0DLGM 50, Fusion 100
Index100%74.385.5

Under your own training objective

The simulator is a small mirror of the live binary-weight block (12 layers, width 256), trained for 1,200 steps with your real mix of objectives and scored on held-out text. Lower loss is better. Candidate layers replace attention on 3 of every 4 layers.

RunSeedsARSATNATGain, equal steps4x contextms per stepGain, equal sim time
Live block (base, base_r2, base_r3; 3 distinct seeds)75.24295.46425.84460-0.3162020
DLGM #458, faithful form (dlgm458)35.09655.38065.8133+0.111 ± 0.007-0.067461 (x2.37)-0.003
Fusion #879, faithful form (fusion879)35.07185.35975.7861+0.135 ± 0.004-0.082370 (x1.90)+0.032
DLGM #458, low-rank form (dlgm458_lr)35.09015.37975.8043+0.117 ± 0.002-0.089543 (x2.79)-0.047
Fusion #879, low-rank form (fusion879_lr)35.10745.39085.8154+0.102 ± 0.013-0.118744 (x3.82)-0.150
DLGM #458, low-rank gate, per-channel kernels (dlgm458_lrk)35.08515.37235.8081+0.120 ± 0.011-0.071412 (x2.12)+0.013
Fusion #879, low-rank gate, per-channel kernels (fusion879_lrk)35.09835.38305.8000+0.112 ± 0.004-0.088393 (x2.02)+0.008
DLGM #458, low-rank gate with a trained projection, per-channel kernels (dlgm458_lg)35.09045.37235.8069+0.117 ± 0.025-0.058321 (x1.65)+0.067
Fusion #879, low-rank gate with a trained projection, per-channel kernels (fusion879_lg)35.09775.38265.8037+0.112 ± 0.015-0.095280 (x1.44)+0.066
DLGM #458, per-head norm check (dlgm458_hn)35.10915.38955.8113+0.102 ± 0.004-0.073362 (x1.86)+0.018
Fusion #879, per-head norm check (fusion879_hn)35.08305.37055.8011+0.123 ± 0.006-0.061317 (x1.63)+0.056

Gain = live block minus candidate on 0.6 AR + 0.2 SAT + 0.2 NAT, in nats, so positive is better; ± is one standard error across seeds. “4x context” is how much the loss on the last 256 tokens improves when the model also sees the 768 tokens before them (positive helps, negative hurts). “Equal sim time” charges each candidate for its step cost in this small simulator.

How firm is it

“Neither ahead” means the index gap is inside the 3-point band fixed in advance; it does not prove the two are equal. The random re-weighting shows how much the result depends on my choice of weights; it is not a probability that either is better. Each comparison below pairs the two candidates seed by seed.

Known limits of tonight’s Fusion run

At full scale: 560 layers

At 560 blocks, width 8192Binary latentsExtra floating-point parameters for the mixerCandidate layers
Live block886.9 B00
DLGM #458, low-rank886.9 B10,106,880420
Fusion #879, low-rank886.9 B17,794,560420
DLGM #458, low-rank router, per-channel kernels886.9 B180,794,880420
Fusion #879, low-rank gate, per-channel kernels886.9 B284,067,840420
DLGM #458, the same with the projection trained886.9 B290,895,360420
Fusion #879, the same with the projection trained886.9 B394,168,320420
DLGM #458, faithful886.9 B58,532,302,080420
Fusion #879, faithful886.9 B60,390,301,440420

Both candidates keep every binary matrix of the live block (886.9 billion latents at 560 blocks), so storage and streaming are the same for both. The faithful forms add about 58.5 and 60.4 billion 32-bit parameters for their routers and gates, which is too much to train at this size; the low-rank forms add 10.1 and 17.8 million, under a tenth of a gigabyte, which is nothing; the gentler cut that keeps the per-channel kernels adds about 0.2 and 0.3 billion (0.7 and 1.1 GB of 32-bit weights). Every cut-down form also carries a fixed projection table of 110 million values per candidate (0.44 GB), which this column does not count, and training holds about four times the weight bytes (weights, gradient and two optimizer moments: roughly 2.9 and 4.5 GB for the gentler cut). So only the cut-down forms could run. These are counts of parameters, not measured memory, and no form has been run at this size.

“Equal time” is the simulator’s model, not a full-scale measurement. In the small mirror a candidate step costs two to three times a live-block step, because at width 256 the mixer’s convolutions and memory updates are large next to tiny matrices. At width 8192 the arithmetic runs the other way: a block spends about 800 million multiply-adds per token in its binary matrices, attention over 2,048 tokens about 34 million, and either mixer about 6 million. By that count both candidates would cost about the same per step as the live block, and the two differ from each other by well under 1%. The count leaves out optimizer work, the projection tables and memory traffic, so it cannot settle speed. Nobody has timed either mixer inside the real trainer.

How the index is built

For a gain component each candidate scores 100 x max(gain, 0) / max(gain of DLGM, gain of Fusion, floor). The better one gets 100 when its gain clears the noise floor, the other gets its share of that gain, and a candidate that does not beat the shared baseline gets 0. Where a component has sub-experiments they are scored separately and averaged. Index = weighted sum of the component scores (0 to 100).

The name on top is the higher index. A margin under 3 points is called level in words.

Formula file: index_spec_v1.json (sha256 fda0f7ad167e19c1…), frozen 2026-11-12T01:59:02Z. Everything on this page as data: index.json.

What was run tonight