Dontopedia
Explore

Spectral Plus Lohe V2

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Spectral Plus Lohe V2 has 37 facts recorded in Dontopedia across 6 references, with 2 live disagreements.

37 facts·32 predicates·6 sources·2 in dispute

Mostly:has loss at step(5), has throughput(2), has attn r(1)

Maturity scale raw canonical shape-checked rule-derived certified

Has Throughputin disputehasThroughput

  • 38.2K tok/s[5]all time · Part 201
  • 11665[6]all time · Part 204

Has Loss at Stepin disputehasLossAtStep

  • 7.3274[5]all time · Part 201
  • 7.4139[5]all time · Part 201
  • 7.4532[5]all time · Part 201
  • 7.4257[5]all time · Part 201
  • 7.2788[5]all time · Part 201

Has Attn RhasAttnR

  • 0[6]all time · Part 204

Has Global RhasGlobalR

  • 0.1905[6]all time · Part 204

Has ParamshasParams

  • 107497440[6]all time · Part 204

Has Sys RhasSysR

  • 0.669[6]all time · Part 204

Has Tok Per ShasTokPerS

  • 11665[6]all time · Part 204

Has Val PplhasValPpl

  • 2490.7[6]all time · Part 204

Has Wall Time MinuteshasWallTimeMinutes

  • 5.9[6]all time · Part 204

Serves As BaselineservesAsBaseline

Exhibits Loss DescentexhibitsLossDescent

Shows Loss ImprovementshowsLossImprovement

  • from 7.4532 to 7.2788[5]all time · Part 201

Inbound mentions (18)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

usesUses(4)

combinesCombines(1)

hasLowerParamCountThanHas Lower Param Count Than(1)

hasLowerThroughputHas Lower Throughput(1)

hasSlightlyWorseQualityThanHas Slightly Worse Quality Than(1)

highlightsKeyResultHighlights Key Result(1)

isComparedToBaselineIs Compared to Baseline(1)

isComponentOfIs Component of(1)

isFasterThanIs Faster Than(1)

isSameForBothConfigsIs Same for Both Configs(1)

matchesLossDescentMatches Loss Descent(1)

outperformsLossDescentOutperforms Loss Descent(1)

preferredOverBaselinePreferred Over Baseline(1)

runsAtSameSeqBatchAsRuns at Same Seq Batch As(1)

zeroForSpectralZero for Spectral(1)

Other facts (20)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

20 facts
PredicateValueRef
Causes More Data Seen in Equal TimeSpectral Plus Gelu[3]
Has Fewer Parameters ThanSpectral Plus Gelu[3]
Has Higher Ppl ThanSpectral Plus Gelu[3]
Has Parameter Count37.4[3]
Has Percent of Parameters ofSpectral Plus Gelu[3]
Has Percent Quality ofSpectral Plus Gelu[3]
Has Validation Perplexity278.2[3]
Matches Result Pattern ofCuda Spectralgpt[3]
Runs Percent Faster ThanSpectral Plus Gelu[3]
Benefits From Longer SeqMeaningful[2]
Is Meaningful forLonger Seq[2]
Has Ppl2491[6]
Runs at Tok Per S Approx11700[6]
Is Efficient AlternativeSpectral Plus Gelu[3]
Likely Closes Performance GapSpectral Plus Gelu[3]
Differs FromSpectral Plus Lohe V3[4]
Version Labelv2[4]
Benefits From Longer Contextmeaningful[1]
Rdfs:labelspectral+lohe_v2[1]
Rdf:typeModel Architecture[1]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

benefitsFromLongerContextblah/watt-activation/125
meaningful
benefitsFromLongerSeqblah/watt-activation/part-125
ex:meaningful
causesMoreDataSeenInEqualTimeblah/watt-activation/part-123
ex:spectral-plus-gelu
differsFromblah/watt-activation/223
ex:spectral-plus-lohe-v3
exhibitsLossDescentblah/watt-activation/part-201
ex:checkmark
hasAttnRblah/watt-activation/part-204
0
hasFewerParametersThanblah/watt-activation/part-123
ex:spectral-plus-gelu
hasGlobalRblah/watt-activation/part-204
0.1905
hasHigherPplThanblah/watt-activation/part-123
ex:spectral-plus-gelu
hasLossAtStepblah/watt-activation/part-201
7.3274
hasLossAtStepblah/watt-activation/part-201
7.4139
hasLossAtStepblah/watt-activation/part-201
7.4532
hasLossAtStepblah/watt-activation/part-201
7.4257
hasLossAtStepblah/watt-activation/part-201
7.2788
hasParameterCountblah/watt-activation/part-123
37.4
hasParamsblah/watt-activation/part-204
107497440
hasPercentOfParametersOfblah/watt-activation/part-123
ex:spectral-plus-gelu
hasPercentQualityOfblah/watt-activation/part-123
ex:spectral-plus-gelu
hasPplblah/watt-activation/part-204
2491
hasSysRblah/watt-activation/part-204
0.669
hasThroughputblah/watt-activation/part-201
38.2K tok/s
hasThroughputblah/watt-activation/part-204
11665
hasTokPerSblah/watt-activation/part-204
11665
hasValidationPerplexityblah/watt-activation/part-123
278.2
hasValPplblah/watt-activation/part-204
2490.7
hasWallTimeMinutesblah/watt-activation/part-204
5.9
isEfficientAlternativeblah/watt-activation/part-123
ex:spectral-plus-gelu
isMeaningfulForblah/watt-activation/part-125
ex:longer-seq
likelyClosesPerformanceGapblah/watt-activation/part-123
ex:spectral-plus-gelu
matchesResultPatternOfblah/watt-activation/part-123
ex:cuda-spectralgpt
labelblah/watt-activation/125
spectral+lohe_v2
typeblah/watt-activation/125
ex:ModelArchitecture
runsAtTokPerSApproxblah/watt-activation/part-204
11700
runsPercentFasterThanblah/watt-activation/part-123
ex:spectral-plus-gelu
servesAsBaselineblah/watt-activation/part-204
ex:lohe-spherical-plus-lohe-v2
showsLossImprovementblah/watt-activation/part-201
from 7.4532 to 7.2788
versionLabelblah/watt-activation/223
v2

References (6)

6 references
  1. customctx:discord/blah/watt-activation/125
    • full textwatt-activation-125
      text/plain3 KBdoc:agent/watt-activation-125/078b0573-153a-47f9-81de-fbf8dd1915e3
      Show excerpt
      [2026-03-09 03:33] xenonfun: ❯ we want to do 2K seq tho ⏺ Doubling seq doubles the activation memory. BS=8, seq=2048 = same logit tensor size as BS=16, seq=1024 — which hit 85GB. We need to re-check BS. BS=4, seq=2048 = 8,192 tokens/bat
  2. [2]Part 1252 facts
    customctx:discord/blah/watt-activation/part-125
  3. [3]Part 12311 facts
    customctx:discord/blah/watt-activation/part-123
  4. customctx:discord/blah/watt-activation/223
    • full textwatt-activation-223
      text/plain2 KBdoc:agent/watt-activation-223/5ca6c9c7-cd04-43a7-bc21-d7dc83321f1b
      Show excerpt
      [2026-03-11 05:06] xenonfun: oh that was older checkpoint ... ⏺ The probe works. But this checkpoint uses spectral+lohe_v2 (not v3), so no mode_power field. The r values are flat across blocks (0.49–0.63) — that's expected for eval mode o
  5. [5]Part 2018 facts
    customctx:discord/blah/watt-activation/part-201
  6. [6]Part 20411 facts
    customctx:discord/blah/watt-activation/part-204

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.