Spectral Plus Lohe V2
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Spectral Plus Lohe V2 has 37 facts recorded in Dontopedia across 6 references, with 2 live disagreements.
Mostly:has loss at step(5), has throughput(2), has attn r(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedHas Throughputin disputehasThroughput
Has Loss at Stepin disputehasLossAtStep
Has Attn RhasAttnR
- 0[6]all time · Part 204
Has Global RhasGlobalR
- 0.1905[6]all time · Part 204
Has ParamshasParams
- 107497440[6]all time · Part 204
Has Sys RhasSysR
- 0.669[6]all time · Part 204
Has Tok Per ShasTokPerS
- 11665[6]all time · Part 204
Has Val PplhasValPpl
- 2490.7[6]all time · Part 204
Has Wall Time MinuteshasWallTimeMinutes
- 5.9[6]all time · Part 204
Serves As BaselineservesAsBaseline
- Lohe Spherical Plus Lohe V2[6]all time · Part 204
Exhibits Loss DescentexhibitsLossDescent
Shows Loss ImprovementshowsLossImprovement
- from 7.4532 to 7.2788[5]all time · Part 201
Inbound mentions (18)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
usesUses(4)
- 1 Epoch Checkpoint
ex:1-epoch-checkpoint - 1 Epoch Checkpoint
ex:1-epoch-checkpoint - Checkpoint
ex:checkpoint - Spectral Plus Lohe V2 Checkpoint
ex:spectral-plus-lohe-v2-checkpoint
combinesCombines(1)
- Form 1
ex:form-1
hasLowerParamCountThanHas Lower Param Count Than(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
hasLowerThroughputHas Lower Throughput(1)
- Lohe Spherical Attention
ex:lohe-spherical-attention
hasSlightlyWorseQualityThanHas Slightly Worse Quality Than(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
highlightsKeyResultHighlights Key Result(1)
- Xenonfun
ex:xenonfun
isComparedToBaselineIs Compared to Baseline(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
isComponentOfIs Component of(1)
- Lohe V2
ex:lohe-v2
isFasterThanIs Faster Than(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
isSameForBothConfigsIs Same for Both Configs(1)
- Seq Batch
ex:seq-batch
matchesLossDescentMatches Loss Descent(1)
- Lohe Spherical Attention
ex:lohe-spherical-attention
outperformsLossDescentOutperforms Loss Descent(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
preferredOverBaselinePreferred Over Baseline(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
runsAtSameSeqBatchAsRuns at Same Seq Batch As(1)
- Lohe Spherical Plus Lohe V2
ex:lohe-spherical-plus-lohe-v2
zeroForSpectralZero for Spectral(1)
- Attn R
ex:attn-r
Other facts (20)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Causes More Data Seen in Equal Time | Spectral Plus Gelu | [3] |
| Has Fewer Parameters Than | Spectral Plus Gelu | [3] |
| Has Higher Ppl Than | Spectral Plus Gelu | [3] |
| Has Parameter Count | 37.4 | [3] |
| Has Percent of Parameters of | Spectral Plus Gelu | [3] |
| Has Percent Quality of | Spectral Plus Gelu | [3] |
| Has Validation Perplexity | 278.2 | [3] |
| Matches Result Pattern of | Cuda Spectralgpt | [3] |
| Runs Percent Faster Than | Spectral Plus Gelu | [3] |
| Benefits From Longer Seq | Meaningful | [2] |
| Is Meaningful for | Longer Seq | [2] |
| Has Ppl | 2491 | [6] |
| Runs at Tok Per S Approx | 11700 | [6] |
| Is Efficient Alternative | Spectral Plus Gelu | [3] |
| Likely Closes Performance Gap | Spectral Plus Gelu | [3] |
| Differs From | Spectral Plus Lohe V3 | [4] |
| Version Label | v2 | [4] |
| Benefits From Longer Context | meaningful | [1] |
| Rdfs:label | spectral+lohe_v2 | [1] |
| Rdf:type | Model Architecture | [1] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (6)
- custom
ctx:discord/blah/watt-activation/125- full textwatt-activation-125text/plain3 KB
doc:agent/watt-activation-125/078b0573-153a-47f9-81de-fbf8dd1915e3Show excerpt
[2026-03-09 03:33] xenonfun: ❯ we want to do 2K seq tho ⏺ Doubling seq doubles the activation memory. BS=8, seq=2048 = same logit tensor size as BS=16, seq=1024 — which hit 85GB. We need to re-check BS. BS=4, seq=2048 = 8,192 tokens/bat…
- custom
ctx:discord/blah/watt-activation/part-125 - custom
ctx:discord/blah/watt-activation/part-123 - custom
ctx:discord/blah/watt-activation/223- full textwatt-activation-223text/plain2 KB
doc:agent/watt-activation-223/5ca6c9c7-cd04-43a7-bc21-d7dc83321f1bShow excerpt
[2026-03-11 05:06] xenonfun: oh that was older checkpoint ... ⏺ The probe works. But this checkpoint uses spectral+lohe_v2 (not v3), so no mode_power field. The r values are flat across blocks (0.49–0.63) — that's expected for eval mode o…
- custom
ctx:discord/blah/watt-activation/part-201 - custom
ctx:discord/blah/watt-activation/part-204
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.