Comparison of Final Val PPL
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Comparison of Final Val PPL has 37 facts recorded in Dontopedia across 10 references, with 4 live disagreements.
Mostly:rdf:type(3), compares model configuration(2), has comparison target(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (3)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
assertsComparisonAsserts Comparison(1)
- Xenonfun
ex:xenonfun
containsObservationContains Observation(1)
- Log Entry 2026 03 09 03 00
ex:log-entry-2026-03-09-03-00
involvesComparisonInvolves Comparison(1)
- Experiment a
ex:experiment-a
Other facts (35)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Performance Comparison | [1] |
| Rdf:type | Comparison | [6] |
| Rdf:type | Comparison | [10] |
| Compares Model Configuration | Spectral Lohe V2 37 4m | [4] |
| Compares Model Configuration | Spectral Gelu 92 9m | [4] |
| Has Comparison Target | vq_layer=1 | [6] |
| Has Comparison Target | vq_layer=2 | [6] |
| Compares Subject | Iteration 62500 | [1] |
| Compares With | Iteration 62200 | [1] |
| Sequence Length Change | 4 | [2] |
| Wall Time Multiplier | 1.43 | [2] |
| Implies | Quadratic Term Acceleration | [2] |
| Compares Subject1 | Groupedlinear | [3] |
| Compares Subject2 | Resonancev2 | [3] |
| Metric | FLOPs | [3] |
| Ratio | ~12x | [3] |
| Direction of Comparison | more | [3] |
| Parameter Ratio | 40 percent | [4] |
| Quality Ratio | 93 percent | [4] |
| Speed Ratio | 74 percent faster | [4] |
| Inference About Wall Clock Time | would see more data | [4] |
| Inference About Gap Closing | likely close that gap further | [4] |
| Matches Pattern | Cuda Spectralgpt Result Pattern | [4] |
| Has Baseline | Fp32 Configuration | [5] |
| Has Comparison | Ternary 1 58 Bit Configuration | [5] |
| Percentage Difference | +6.9% | [5] |
| Training Budget | 20000 | [7] |
| Budget Unit | steps | [7] |
| Architecture | Dense Projection Logit Decoder | [8] |
| Has Better Performance | Rotor Block | [9] |
| Has Worse Performance | Helmholtz Block | [9] |
| In Context of | Ofdm 32 | [9] |
| Compares | Metric Best Bpb | [10] |
| Has Result | better than predicted | [10] |
| Compares to | Predicted Bpb | [10] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (10)
ctx:discord/blah/watt-activation/32- full textwatt-activation-32text/plain3 KB
doc:agent/watt-activation-32/8e8fa426-eb3a-4cc0-8c6a-550ba45f969fShow excerpt
[2026-03-06 21:37] xenonfun: ====================================================================== Evaluation at iteration 20000 (~20% thru data) ====================================================================== Prompt: 'virtue is' Ge…
ctx:discord/blah/watt-activation/57- full textwatt-activation-57text/plain2 KB
doc:agent/watt-activation-57/2be5a3f3-fa33-4f3c-809c-45db01bc0deaShow excerpt
[2026-03-07 09:27] xenonfun: ``` Good question. Let me extrapolate from our existing data. Measured throughput (pairwise, batch=1): ┌─────────┬──────┬─────────┬───────┐ │ Seq Len │ it/s │ ms/iter │ tok/s │ ├─────────┼──────┼──────…
ctx:discord/blah/watt-activation/101- full textwatt-activation-101text/plain3 KB
doc:agent/watt-activation-101/6f90e9c2-2d77-484f-96fd-98a89c99440aShow excerpt
[2026-03-08 18:08] xenonfun: ### Concrete comparison at T=4096, H=12, d_h=64: ResonanceV2 (cumsum, K=8 bands): Work: 12 × 8 × 4096 × 64 = 25M multiply-adds Kernel launches: ~K cumsums = 8 Metal kernels Memory: O(T · H · K · …
ctx:discord/blah/watt-activation/123- full textwatt-activation-123text/plain3 KB
doc:agent/watt-activation-123/2baaacb5-8c72-45ab-a16f-f5292a255289Show excerpt
[2026-03-09 02:56] xenonfun: ``` val ppl=262.1 train ppl=223.9 321ms/step 12,779tok/s ──────────────────────────────────────────────────────────────────────── [kan+lohe_v2] params: 37.27M iter 50/1000 loss=8.6248 ppl= 5568.2 …
ctx:discord/blah/watt-activation/276- full textwatt-activation-276text/plain3 KB
doc:agent/watt-activation-276/53331a47-df58-4d3f-a691-96a8098e7b35Show excerpt
[2026-03-13 21:31] xenonfun: ⏺ Results are in: ``` ┌───────────────┬───────────────┬────────────────────────────────┬───────┐ │ │ fp32 │ Ternary 1.58-bit │ Delta │ ├───────────────┼───────────────┼…
ctx:discord/blah/watt-activation/278- full textwatt-activation-278text/plain3 KB
doc:agent/watt-activation-278/f9f6e4c6-b1f8-402a-a4dc-d3b356140759Show excerpt
[2026-03-13 22:26] xenonfun: ⏺ Exp 0 result: direction/gain split is safe. Key findings: ``` ┌─────────────┬─────────────┬───────────────────────────────────────┬────────────────────────────────────────────────┐ │ Metric │ Ea…
ctx:discord/blah/watt-activation/324- full textwatt-activation-324text/plain2 KB
doc:agent/watt-activation-324/5428b43d-e96d-4178-8924-6d7c75574aa4Show excerpt
[2026-03-15 03:48] xenonfun: ## Design (files: Screenshot_2026-03-14_at_11.48.03_PM.png) [2026-03-15 03:49] xenonfun: (files: Screenshot_2026-03-14_at_11.49.32_PM.png) [2026-03-15 04:03] xenonfun: You went from 2.39 → 1.572 today. You cros…
ctx:discord/blah/watt-activation/344- full textwatt-activation-344text/plain3 KB
doc:agent/watt-activation-344/aa3dc64f-a03a-4cc7-a0ef-a9fda84ff8b8Show excerpt
[2026-03-15 23:37] xenonfun: ``` ⏺ K is the Lohe coupling strength — it controls how strongly groups pull toward their mean field during sync. Currently frozen at init value 1/sqrt(G*H) ≈ 0.177. The critical coupling is K_c = H/(H-1) = 1.…
ctx:discord/blah/watt-activation/393- full textwatt-activation-393text/plain3 KB
doc:agent/watt-activation-393/d9206d9a-8fe3-4b8a-9bba-45db3179f660Show excerpt
[2026-03-19 03:51] xenonfun: ⏺ Excellent results! Almost all done. Here's the encoding comparison with proper LR: ``` ┌─────────┬───────────┬───────────┬──────────┬───────┬───────┬────────┐ │ Config │ Encoding │ Block │ BPB @500 │…
ctx:discord/blah/watt-activation/460- full textwatt-activation-460text/plain3 KB
doc:agent/watt-activation-460/b1f5e9cd-e022-4479-b238-062663ee77dfShow excerpt
[2026-03-21 16:56] xenonfun: ⏺ Results on fineweb_edu_bytes.bin (623MB): ``` ┌────────────────┬──────────────────────────────────────┐ │ Metric │ Value │ ├────────────────┼───────────────────────…
See also
- Performance Comparison
- Iteration 62500
- Iteration 62200
- Quadratic Term Acceleration
- Groupedlinear
- Resonancev2
- Spectral Lohe V2 37 4m
- Spectral Gelu 92 9m
- Cuda Spectralgpt Result Pattern
- Fp32 Configuration
- Ternary 1 58 Bit Configuration
- Comparison
- Dense Projection Logit Decoder
- Rotor Block
- Helmholtz Block
- Ofdm 32
- Metric Best Bpb
- Predicted Bpb
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.