ASI-ARCH, POINTED AT AGILLM

Which architecture is actually best for your 600B?

One ranked table. Every candidate is scored on what your binary, sparse, streaming system needs. 50 = your current block; higher means better.

Loading live status…

The unified index

Loading…

#ArchitectureFit Quality Streaming KV/token Long ctx Stability Novelty Evidence
Loading the index…

What "Fit" measures, and why

The upstream ASI-Arch objective scored linear-attention kernels on benchmarks. Your cluster is a different problem, so the objective was rebuilt around it.

WeightComponentWhat it measuresThe live problem it targets
55%Quality at equal box timeHeld-out cross-entropy (AR 60, SAT 20, NAT 20) compared at the token count each candidate reaches in the same wall-clock as your block, using its real streaming bytes and measured step cost278 s/step dominated by latent streaming; 12.8M tokens seen at 600B; deep undertraining, so learning per step and per byte is what counts
15%ScaleLatent bytes at real 600B scale (from the candidate's actual module catalog)Sub-bit storage on the path to 1T; disk and streaming bills
10%StabilityLocal-denoise loss spike rate and levelThe run halted on the local-denoise loss guard (26.2 vs limit 25)
10%Long contextHeld-out NLL gain from 1,024 tokens of context vs 256 (trained at 256). Avoiding harm earns up to the gap to your block; only a real gain from the extra context earns moreRoPE fails past the trained length; NoPE hurts NAT
10%ServingKV state bytes per generated token at 600B scale24.9 MB/token is the binding term on the 1660
What this is: a small, faithful mirror of your live training system (same binary latent update rule, top-1 MoE, AR/SAT/NAT schedule, 1-in-9 local-denoise, real data sources and tokenizer; d=256, L=12, vocab 8,192). Its catalog census reproduces the real 600B exactly (601,832,292,352 latent bytes, 2,622 matrices). What it is not: a 600B result. It predicts direction and relative cost, with few seeds so far. Sim results show which ideas deserve a real A/B on the 2060S before going near the live run.

Earlier versions of this page ranked the 105 upstream programs on the upstream goal and kept a separate 200-entry grid that was never scored. Those pages are kept here: old 105 index · old 200-grid gallery.