Dontopedia

spectral

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-07-03.)

spectral has 106 facts recorded in Dontopedia across 13 references, with 6 live disagreements.

106 facts·85 predicates·13 sources·6 in dispute

Mostly:has ppl at step(7), rdf:type(6), has tokens per second(2)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (53)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

comparedToCompared to(2)

hasFewerParametersThanHas Fewer Parameters Than(2)

believesSpectralBetterLmBelieves Spectral Better Lm(1)

comparesPplCompares Ppl(1)

comparesTokPerSCompares Tok Per S(1)

containsModelContains Model(1)

describesForwardThroughputDescribes Forward Throughput(1)

evaluatesAsBetterLanguageModelEvaluates As Better Language Model(1)

exhibitsMuchRicherSpecializationThanExhibits Much Richer Specialization Than(1)

expertTypeExpert Type(1)

fasterThanFaster Than(1)

followsFollows(1)

has13PercentFewerParamsThanHas13 Percent Fewer Params Than(1)

has19PercentSpeedAdvantageHas19 Percent Speed Advantage(1)

has27PercentFewerParamsThanHas27 Percent Fewer Params Than(1)

hasHighestRInHas Highest R in(1)

hasMemberHas Member(1)

hasRicherSpecializationHas Richer Specialization(1)

hasStrongDcSyncHubHas Strong DC Sync Hub(1)

hasSuperiorQualityHas Superior Quality(1)

hasSyncHubRoleForConfigHas Sync Hub Role for Config(1)

hasWeakerSyncHas Weaker Sync(1)

haveParamCountsNearbyHave Param Counts Nearby(1)

improvesSpeedImproves Speed(1)

includesModelIncludes Model(1)

involvesComponentInvolves Component(1)

is120xFasterIs120x Faster(1)

is25PercentFasterThanIs25 Percent Faster Than(1)

is47PercentFasterThanIs47 Percent Faster Than(1)

isConsistentWithBetterPplIs Consistent With Better Ppl(1)

isFasterIs Faster(1)

isHigherInIs Higher in(1)

isMoreOrderedAtSameCouplingIs More Ordered at Same Coupling(1)

isNotablyFlatterThanIs Notably Flatter Than(1)

isOutputOfIs Output of(1)

isPatternOfIs Pattern of(1)

isSparserIs Sparser(1)

isStrictlyBetterThanIs Strictly Better Than(1)

measuredForMeasured for(1)

measuresDifferenceBetweenMeasures Difference Between(1)

mentionsMentions(1)

overtakesOvertakes(1)

propertyProperty(1)

reportsConvergenceReports Convergence(1)

reportsHigherThermodynamicBetaReports Higher Thermodynamic Beta(1)

reportsSysRReports Sys R(1)

representsSameSignalRepresents Same Signal(1)

risesInRises in(1)

slowerDueTo5DTensorsSlower Due To5 D Tensors(1)

tendedTowardByTended Toward by(1)

underperformsUnderperforms(1)

Other facts (101)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

101 facts
PredicateValueRef
Has Ppl at Step1140[8]
Has Ppl at Step561[8]
Has Ppl at Step501[8]
Has Ppl at Step373[8]
Has Ppl at Step260[8]
Has Ppl at Step219[8]
Has Ppl at Step239[8]
Rdf:typeModel Component[9]
Rdf:typeAttention Configuration[10]
Rdf:typeModel Architecture[11]
Rdf:typeAttention Type[12]
Rdf:typeModel Kind[13]
Rdf:typeModel[13]
Has Tokens Per Second12815[6]
Has Tokens Per Second12815[12]
Has Loss9.02[6]
Has Loss9.02[12]
Has Param Count107.2M[6]
Has Param Count107200000[12]
Achieved Throughput43700[11]
Achieved Throughput46300[11]
Throughput Unittok/s[13]
Throughput Unittokens per second[13]
Better in Training ThanPytorch Mps[1]
Peaks at Forward Throughput365000[1]
Is Four Times Faster ThanPytorch Mps[1]
Has Training Throughput84800[1]
Has Latency Scaling7.9[1]
Exhibits ScalingSuper Linear Ish[1]
Presupposes Competitor to Gpt{}[2]
Has Essential StabilityMemory Standard[2]
OutperformsGpt[2]
Was StableMemory Standard[2]
Reaches Same DC Sync Strength AsAnchor Kan[3]
Has Tok S12000[3]
Has R Hub0.56[3]
Has Sync HubBlock 10[3]
Sync Hub PrecedesAnchor Kan[3]
Has DC Mode0.315[3]
Tends Toward Run on Noun Phrasestrue[4]
Lacks5 D Tensortrue[4]
Faster Than AnchorkanAnchorkan[4]
References in ComparisonAnchorkan[4]
Outputs Longer Word Like Runs"The not used in the be 2001 3 -5 of a same"[4]
Has Speed~400 tok/s[4]
Includes Numbers and Partial Structuretrue[4]
Has Dominant H0 in L2true[5]
Forms Sync HubL2[5]
Has26 Percent Ppl GapAnchor Kan[5]
Has DC Synchronization HubL2 H0[5]
Is More Orderedtrue[5]
Reaches Higher Final OrderAnchor Kan[5]
Has Smoother ConvergenceAnchor Kan[5]
Has Higher BetaAnchor Kan[5]
Optimizes Ppltrue[5]
Implements True Rope in Qktrue[5]
Has Ppl Per Token0.64[6]
Has Same Model Quality AsLohe Spherical[6]
Converges Identically toLohe Spherical[6]
Has Param Count Approx17M[6]
Has Ppl8228[6]
Has Best Qualitytrue[7]
Has Ppl6.03[7]
Has Tokens Per Second at Temp256210000[7]
Has Quality Adjusted Tokens Per Second8008[7]
Has Tok Per S56931[8]
Has Final Ppl239[8]
Has Params16.9M[8]
Second Best in Pplnull[8]
UsesFunk Hecke Decomposition[8]
Has Sync Hub LocationBlock 10[10]
Has Sync Strength0.56[10]
Has Baseline Throughput12000[10]
Has Throughput UnitTok S[10]
Achieved Perplexity116.4[11]
Has Speedup Factor120[11]
Benefited FromParallel Prefill[11]
Compatible WithRope Py[11]
Uses Rope ModeTrue Rope Qk[11]
Validation Perplexity116.4[11]
Converges Smoothlytrue[11]
Has Final Order0.36[11]
Phase Statedisordered[11]
Classified AsBetter Language Model[11]
Has Perplexity8228[12]
Has Ppl Per Token0.64[12]
Outputs PatternWord Like Runs[13]
Outputs Sample TextSpectral Output Sample[13]
Tends Toward Output PatternRun on Noun Phrases[13]
Described SpeedFaster[13]
Approximate Throughput400[13]
Output Lengthlonger[13]
Appears inCode Block[13]
Outputs SampleSpectral Output Sample[13]
PrecedesAnchor Kan[13]
Output Characteristiclonger word-like runs[13]
Example OutputThe not used in the be 2001 3 -5 of a same[13]
Includesnumbers and partial structure[13]
Tends Towardrun-on noun phrases[13]
Performancefaster[13]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

betterInTrainingThanblah/watt-activation/part-104
ex:pytorch-mps
peaksAtForwardThroughputblah/watt-activation/part-104
365000
isFourTimesFasterThanblah/watt-activation/part-104
ex:pytorch-mps
hasTrainingThroughputblah/watt-activation/part-104
84800
hasLatencyScalingblah/watt-activation/part-104
7.9
exhibitsScalingblah/watt-activation/part-104
ex:super-linear-ish
presupposesCompetitorToGptblah/watt-activation/part-125
{}
hasEssentialStabilityblah/watt-activation/part-125
ex:memory-standard
outperformsblah/watt-activation/part-125
ex:gpt
wasStableblah/watt-activation/part-125
ex:memory-standard
reachesSameDcSyncStrengthAsblah/watt-activation/part-221
ex:anchor-kan
hasTokSblah/watt-activation/part-221
12000
hasRHubblah/watt-activation/part-221
0.56
hasSyncHubblah/watt-activation/part-221
ex:block-10
syncHubPrecedesblah/watt-activation/part-221
ex:anchor-kan
hasDcModeblah/watt-activation/part-221
0.315
tendsTowardRunOnNounPhrasesblah/watt-activation/part-232
true
lacks5DTensorblah/watt-activation/part-232
true
fasterThanAnchorkanblah/watt-activation/part-232
ex:anchorkan
referencesInComparisonblah/watt-activation/part-232
ex:anchorkan
outputsLongerWordLikeRunsblah/watt-activation/part-232
"The not used in the be 2001 3 -5 of a same"
hasSpeedblah/watt-activation/part-232
~400 tok/s
includesNumbersAndPartialStructureblah/watt-activation/part-232
true
hasDominantH0InL2blah/watt-activation/part-236
true
formsSyncHubblah/watt-activation/part-236
ex:l2
has26PercentPplGapblah/watt-activation/part-236
ex:anchor-kan
hasDcSynchronizationHubblah/watt-activation/part-236
ex:l2-h0
isMoreOrderedblah/watt-activation/part-236
true
reachesHigherFinalOrderblah/watt-activation/part-236
ex:anchor-kan
hasSmootherConvergenceblah/watt-activation/part-236
ex:anchor-kan
hasHigherBetablah/watt-activation/part-236
ex:anchor-kan
optimizesPplblah/watt-activation/part-236
true
implementsTrueRopeInQKblah/watt-activation/part-236
true
hasPPLPerTokenblah/watt-activation/part-317
0.64
hasSameModelQualityAsblah/watt-activation/part-317
ex:lohe-spherical
hasTokensPerSecondblah/watt-activation/part-317
12815
convergesIdenticallyToblah/watt-activation/part-317
ex:lohe-spherical
hasLossblah/watt-activation/part-317
9.02
hasParamCountblah/watt-activation/part-317
107.2M
hasParamCountApproxblah/watt-activation/part-317
17M
hasPPLblah/watt-activation/part-317
8228
hasBestQualityblah/watt-activation/part-103
true
hasPplblah/watt-activation/part-103
6.03
hasTokensPerSecondAtTemp256blah/watt-activation/part-103
210000
hasQualityAdjustedTokensPerSecondblah/watt-activation/part-103
8008
hasTokPerSblah/watt-activation/part-319
56931
hasFinalPplblah/watt-activation/part-319
239
hasParamsblah/watt-activation/part-319
16.9M
hasPplAtStepblah/watt-activation/part-319
1140
hasPplAtStepblah/watt-activation/part-319
561
hasPplAtStepblah/watt-activation/part-319
501
hasPplAtStepblah/watt-activation/part-319
373
hasPplAtStepblah/watt-activation/part-319
260
hasPplAtStepblah/watt-activation/part-319
219
hasPplAtStepblah/watt-activation/part-319
239
secondBestInPplblah/watt-activation/part-319
null
usesblah/watt-activation/part-319
ex:funk-hecke-decomposition
typeblah/watt-activation/204
ex:ModelComponent
labelblah/watt-activation/204
spectral
typeblah/watt-activation/220
ex:AttentionConfiguration
labelblah/watt-activation/220
spectral
hasSyncHubLocationblah/watt-activation/220
ex:block-10
hasSyncStrengthblah/watt-activation/220
0.56
hasBaselineThroughputblah/watt-activation/220
12000
hasThroughputUnitblah/watt-activation/220
ex:tok-s
typeblah/watt-activation/235
ex:ModelArchitecture
labelblah/watt-activation/235
spectral
achievedPerplexityblah/watt-activation/235
116.4
achievedThroughputblah/watt-activation/235
43700
hasSpeedupFactorblah/watt-activation/235
120
benefitedFromblah/watt-activation/235
ex:parallel-prefill
compatibleWithblah/watt-activation/235
ex:rope-py
usesRopeModeblah/watt-activation/235
ex:true-rope-qk
validationPerplexityblah/watt-activation/235
116.4
convergesSmoothlyblah/watt-activation/235
true
achievedThroughputblah/watt-activation/235
46300
hasFinalOrderblah/watt-activation/235
0.36
phaseStateblah/watt-activation/235
disordered
classifiedAsblah/watt-activation/235
ex:better-language-model
typeblah/watt-activation/315
ex:AttentionType
labelblah/watt-activation/315
spectral
hasLossblah/watt-activation/315
9.02
hasPerplexityblah/watt-activation/315
8228
hasTokensPerSecondblah/watt-activation/315
12815
hasParamCountblah/watt-activation/315
107200000
hasPplPerTokenblah/watt-activation/315
0.64
labeldocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
Spectral
typedocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:model-kind
outputsPatterndocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:word-like-runs
outputsSampleTextdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:spectral-output-sample
tendsTowardOutputPatterndocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:run-on-noun-phrases
describedSpeeddocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
Faster
approximateThroughputdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
400
throughputUnitdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
tok/s
outputLengthdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
longer
appearsIndocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:code-block
outputsSampledocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:spectral-output-sample
precedesdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:anchor-kan
typedocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
ex:Model
outputCharacteristicdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
longer word-like runs
exampleOutputdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
The not used in the be 2001 3 -5 of a same
includesdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
numbers and partial structure
tendsTowarddocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
run-on noun phrases
performancedocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
faster
throughputdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
400
throughputUnitdocument/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
tokens per second

References (13)

13 references
  1. [1]Part 1046 facts
    ctx:discord/blah/watt-activation/part-104
  2. [2]Part 1254 facts
    ctx:discord/blah/watt-activation/part-125
  3. [3]Part 2216 facts
    ctx:discord/blah/watt-activation/part-221
  4. [4]Part 2327 facts
    ctx:discord/blah/watt-activation/part-232
  5. [5]Part 23610 facts
    ctx:discord/blah/watt-activation/part-236
  6. [6]Part 3178 facts
    ctx:discord/blah/watt-activation/part-317
  7. [7]Part 1034 facts
    ctx:discord/blah/watt-activation/part-103
  8. [8]Part 31912 facts
    ctx:discord/blah/watt-activation/part-319
  9. [9]2042 facts
    ctx:discord/blah/watt-activation/204
    • full textwatt-activation-204
      text/plain3 KBdoc:agent/watt-activation-204/c8f804b0-ce31-4b4d-9ff6-960a682fa16d
      Show excerpt
      [2026-03-10 07:26] xenonfun: those are all with `opt = RotationalAdamW(model, lr=1e-4, weight_decay=0.01, zero_mean=True)` optimizer. ``` ⏺ Right — the whole point of Form 2 was to give LoheOptimizer a real order parameter instead of the
  10. [10]2206 facts
    ctx:discord/blah/watt-activation/220
    • full textwatt-activation-220
      text/plain3 KBdoc:agent/watt-activation-220/5c7f4a28-90e7-46de-ae1e-9e19a58c8d65
      Show excerpt
      [2026-03-11 04:42] xenonfun: FFN DFT — much richer specialization than spectral: ``` ┌─────┬───────┬────────┬────────────────┬────────────────┐ │ blk │ r │ FFN DC │ dominant mode │ pattern │ ├─────┼───────┼────────┼───────
  11. [11]23514 facts
    ctx:discord/blah/watt-activation/235
    • full textwatt-activation-235
      text/plain2 KBdoc:agent/watt-activation-235/2b477fba-6b21-4139-a3e7-6c48c5dad99f
      Show excerpt
      [2026-03-11 22:42] xenonfun: ⏺ Done. Pushed 34b7246. Summary of what landed: - Results: anchor_kan best ppl 155.6 / 52K tok/s, spectral 116.4 / 43.7K tok/s - parallel prefill: 120× faster for spectral, auto-fallback for anchor_kan -
  12. [12]3157 facts
    ctx:discord/blah/watt-activation/315
    • full textwatt-activation-315
      text/plain2 KBdoc:agent/watt-activation-315/5f801374-2b73-4ce9-bd06-bdb14c70d743
      Show excerpt
      [2026-03-15 01:50] xenonfun: ``` ⏺ Attention Type Comparison (200 steps, d=768, 12L, 12H, compiled) ┌────────────────┬──────┬───────┬────────┬────────┬─────────┐ │ Attention │ Loss │ PPL │ Tok/s │ Params │ PPL/tok │ ├────────
  13. ctx:claims/document/019a8f6a-d43b-40ba-afc1-247f4b73c3a5
    • full textxenonfun: well not that much speed up 46K now peak, think its memory bound already. 8K voc
      text/plain680 Bdiscord:msg/a3126764-fdd1-42f8-9653-a5170ea5bdef
      Show excerpt
      xenonfun: well not that much speed up 46K now peak, think its memory bound already. 8K vocab is signifigantly worse output at same training but makes sense, model was too lopsided with that much embeddings, but at 100K it did observe intere

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.