Dontopedia

lohe_spherical

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

lohe_spherical has 102 facts recorded in Dontopedia across 22 references, with 5 live disagreements.

102 facts·78 predicates·22 sources·5 in dispute

Mostly:has ppl at step(7), rdf:type(7), has perplexity(2)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (30)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

usesAttentionUses Attention(2)

adaptsToAttentionTypeAdapts to Attention Type(1)

advocatesSphericalAdvocates Spherical(1)

assumesSharedKnowledgeAssumes Shared Knowledge(1)

behindBehind(1)

claimsComponentHasLowerPerplexityClaims Component Has Lower Perplexity(1)

claimsComponentIsFasterClaims Component Is Faster(1)

claimsTradeoffIsOffsetClaims Tradeoff Is Offset(1)

comparedToCompared to(1)

comparesUnfavorablyToCompares Unfavorably to(1)

convergesIdenticallyToConverges Identically to(1)

dependsOnDepends on(1)

describesDescribes(1)

evaluatedSuperiorEvaluated Superior(1)

has4_3xBetterPPLThanHas4 3x Better Ppl Than(1)

hasAttentionTypeHas Attention Type(1)

hasLowerLossThanHas Lower Loss Than(1)

hasSameModelQualityAsHas Same Model Quality As(1)

hasSyncHubRoleForConfigHas Sync Hub Role for Config(1)

involvesComponentInvolves Component(1)

mentionsModelMentions Model(1)

needsDesignAfterResultsNeeds Design After Results(1)

refersToSpecificAttentionRefers to Specific Attention(1)

subjectSubject(1)

subject2Subject2(1)

suggestsSuggests(1)

usedWithUsed With(1)

usesConfigUses Config(1)

usesMethodUses Method(1)

Other facts (95)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

95 facts
PredicateValueRef
Has Ppl at Step1567[13]
Has Ppl at Step517[13]
Has Ppl at Step449[13]
Has Ppl at Step335[13]
Has Ppl at Step216[13]
Has Ppl at Step190[13]
Has Ppl at Step210[13]
Rdf:typeExperiment[14]
Rdf:typeModel Component[15]
Rdf:typeAttention Configuration[17]
Rdf:typeModel[18]
Rdf:typeModel Architecture[19]
Rdf:typeAttention Type[20]
Rdf:typeComponent[21]
Has Perplexity97[6]
Has Perplexity8225[20]
Combined WithLohe V3[7]
Combined WithLohe V3[10]
Has Param Count93.5M[9]
Has Param Count93500000[20]
Has Tokens Per Second16043[9]
Has Tokens Per Second16043[20]
Has Loss9.01[9]
Has Loss9.01[20]
Results Pendingtrue[1]
Is Attention VariantLohe V2[2]
Reduces Qk Params VsSpectralattn[2]
Has Simpler Attention Mechanism ThanSpectralattn[2]
Has Fewer Params in Qk32x768[2]
Has Gh32[3]
Has Dmodel768[3]
Keeps V atfull d_model=768 across GH=32 spectral channels[3]
Has D768[3]
Optimizes Qk But Not Vtrue[3]
Has Kv Inp Shape(B, T, GH=32, D=768)[3]
Achieves Only~60%[4]
Has Weaker SyncSpectral[4]
UnderperformsSpectral[4]
Has DC Mode0.148[4]
Has Sync HubBlock 10[4]
Has Tok S14000[4]
Has R Hub0.385[4]
Uses Ring Topologynull[5]
Gets Partially Therenull[5]
Outperforms OthersCompetitors[6]
Superior inPerplexity Metric[6]
Wins by MarginBig Margin[6]
Is Model ArchitectureTraining Setup[8]
Uses Fewest Parametersnull[9]
Might Catch Up With More Stepsnull[9]
Has Ppl Per Token0.51[9]
Is Strictly Better ThanSpectral[9]
Is Speed Kingtrue[9]
References Lohe Methodnull[9]
Is25 Percent Faster ThanSpectral[9]
Is2 25x Faster ThanTopo Anchor Kan[9]
Has Ppl8225[9]
Excels in Inference Speednull[9]
Recommended forfast iteration/long training[9]
Has13 Percent Fewer Params ThanSpectral[9]
Ontologically EfficientD 512[10]
Causes Fewer ParamsAttention Projections[10]
Parameter Efficient at512[10]
Is Prior Modeltrue[11]
Achieves Bpb2.52[11]
Was FasterPrevious Config[12]
Has Less Ppl Per StepPrevious Config[12]
Wins in Pplnull[13]
Benefits More FromStrong Rotational Dynamics[13]
Has27 Percent Fewer Params ThanSpectral[13]
Has Fewest Paramsnull[13]
Has Final Ppl210[13]
Has Lower Ppl Than Spectral At1000null[13]
Has Params12.3M[13]
Has Tok Per S83777[13]
Is3 2 Times Faster ThanStar Kan[13]
Is47 Percent Faster ThanSpectral[13]
Is Fastestnull[13]
Maintains Lead Throughoutnull[13]
OvertakesSpectral[13]
Overtakes at Step200[13]
Preferred by Authornull[13]
Superior in All Metricsnull[13]
Uses Lohe Syncnull[13]
Uses O T Cumsum Recurrencenull[13]
Wins Everythingnull[13]
Statuspending[14]
Reaches State PartiallyDC Kuramoto State[16]
Has Sync Strength Magnitude0.6[17]
Has Baseline Throughput14000[17]
Has Throughput UnitTok S[17]
Has Ppl Per Token0.51[20]
Propertyparameter-efficient[21]
Component Namelohe_spherical+lohe_v3[21]
Has Bpb2.52[22]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

resultsPendingblah/watt-activation/part-206
true
isAttentionVariantblah/watt-activation/part-204
ex:lohe-v2
reducesQKParamsVsblah/watt-activation/part-204
ex:spectralattn
hasSimplerAttentionMechanismThanblah/watt-activation/part-204
ex:spectralattn
hasFewerParamsInQKblah/watt-activation/part-204
32x768
hasGhblah/watt-activation/part-202
32
hasDmodelblah/watt-activation/part-202
768
keepsVAtblah/watt-activation/part-202
full d_model=768 across GH=32 spectral channels
hasDblah/watt-activation/part-202
768
optimizesQKButNotVblah/watt-activation/part-202
true
hasKvInpShapeblah/watt-activation/part-202
(B, T, GH=32, D=768)
achievesOnlyblah/watt-activation/part-221
~60%
hasWeakerSyncblah/watt-activation/part-221
ex:spectral
underperformsblah/watt-activation/part-221
ex:spectral
hasDcModeblah/watt-activation/part-221
0.148
hasSyncHubblah/watt-activation/part-221
ex:block-10
hasTokSblah/watt-activation/part-221
14000
hasRHubblah/watt-activation/part-221
0.385
usesRingTopologyblah/watt-activation/part-219
null
getsPartiallyThereblah/watt-activation/part-219
null
outperformsOthersblah/watt-activation/part-240
ex:competitors
hasPerplexityblah/watt-activation/part-240
97
superiorInblah/watt-activation/part-240
ex:perplexity-metric
winsByMarginblah/watt-activation/part-240
ex:big-margin
combinedWithblah/watt-activation/part-266
ex:lohe-v3
isModelArchitectureblah/watt-activation/part-262
ex:training-setup
usesFewestParametersblah/watt-activation/part-317
null
hasParamCountblah/watt-activation/part-317
93.5M
mightCatchUpWithMoreStepsblah/watt-activation/part-317
null
hasPPLPerTokenblah/watt-activation/part-317
0.51
isStrictlyBetterThanblah/watt-activation/part-317
ex:spectral
isSpeedKingblah/watt-activation/part-317
true
referencesLoheMethodblah/watt-activation/part-317
null
hasTokensPerSecondblah/watt-activation/part-317
16043
is25PercentFasterThanblah/watt-activation/part-317
ex:spectral
is2_25xFasterThanblah/watt-activation/part-317
ex:topo-anchor-kan
hasLossblah/watt-activation/part-317
9.01
hasPPLblah/watt-activation/part-317
8225
excelsInInferenceSpeedblah/watt-activation/part-317
null
recommendedForblah/watt-activation/part-317
fast iteration/long training
has13PercentFewerParamsThanblah/watt-activation/part-317
ex:spectral
combinedWithblah/watt-activation/part-322
ex:lohe-v3
ontologicallyEfficientblah/watt-activation/part-322
ex:d-512
causesFewerParamsblah/watt-activation/part-322
ex:attention-projections
parameterEfficientAtblah/watt-activation/part-322
512
isPriorModelblah/watt-activation/part-338
true
achievesBpbblah/watt-activation/part-338
2.52
wasFasterblah/watt-activation/part-215
ex:previous-config
hasLessPplPerStepblah/watt-activation/part-215
ex:previous-config
winsInPplblah/watt-activation/part-319
null
benefitsMoreFromblah/watt-activation/part-319
ex:strong-rotational-dynamics
has27PercentFewerParamsThanblah/watt-activation/part-319
ex:spectral
hasFewestParamsblah/watt-activation/part-319
null
hasFinalPplblah/watt-activation/part-319
210
hasLowerPplThanSpectralAt1000blah/watt-activation/part-319
null
hasParamsblah/watt-activation/part-319
12.3M
hasPplAtStepblah/watt-activation/part-319
1567
hasPplAtStepblah/watt-activation/part-319
517
hasPplAtStepblah/watt-activation/part-319
449
hasPplAtStepblah/watt-activation/part-319
335
hasPplAtStepblah/watt-activation/part-319
216
hasPplAtStepblah/watt-activation/part-319
190
hasPplAtStepblah/watt-activation/part-319
210
hasTokPerSblah/watt-activation/part-319
83777
is3-2TimesFasterThanblah/watt-activation/part-319
ex:star-kan
is47PercentFasterThanblah/watt-activation/part-319
ex:spectral
isFastestblah/watt-activation/part-319
null
maintainsLeadThroughoutblah/watt-activation/part-319
null
overtakesblah/watt-activation/part-319
ex:spectral
overtakesAtStepblah/watt-activation/part-319
200
preferredByAuthorblah/watt-activation/part-319
null
superiorInAllMetricsblah/watt-activation/part-319
null
usesLohe-syncblah/watt-activation/part-319
null
usesO-T-cumsum-recurrenceblah/watt-activation/part-319
null
winsEverythingblah/watt-activation/part-319
null
typeblah/watt-activation/205
ex:Experiment
labelblah/watt-activation/205
lohe_spherical
statusblah/watt-activation/205
pending
typeblah/watt-activation/214
ex:ModelComponent
labelblah/watt-activation/214
lohe_spherical
labelblah/watt-activation/218
lohe_spherical
reachesStatePartiallyblah/watt-activation/218
ex:dc-kuramoto-state
typeblah/watt-activation/220
ex:AttentionConfiguration
labelblah/watt-activation/220
lohe_spherical
hasSyncStrengthMagnitudeblah/watt-activation/220
0.6
hasBaselineThroughputblah/watt-activation/220
14000
hasThroughputUnitblah/watt-activation/220
ex:tok-s
typeblah/watt-activation/239
ex:Model
labelblah/watt-activation/239
lohe_spherical
typeblah/watt-activation/237
ex:ModelArchitecture
labelblah/watt-activation/237
lohe_spherical
typeblah/watt-activation/315
ex:AttentionType
labelblah/watt-activation/315
lohe_spherical
hasLossblah/watt-activation/315
9.01
hasPerplexityblah/watt-activation/315
8225
hasTokensPerSecondblah/watt-activation/315
16043
hasParamCountblah/watt-activation/315
93500000
hasPplPerTokenblah/watt-activation/315
0.51
typeblah/watt-activation/320
ex:Component
propertyblah/watt-activation/320
parameter-efficient
componentNameblah/watt-activation/320
lohe_spherical+lohe_v3
hasBPBblah/watt-activation/336
2.52

References (22)

22 references
  1. [1]Part 2061 fact
    ctx:discord/blah/watt-activation/part-206
  2. [2]Part 2044 facts
    ctx:discord/blah/watt-activation/part-204
  3. [3]Part 2026 facts
    ctx:discord/blah/watt-activation/part-202
  4. [4]Part 2217 facts
    ctx:discord/blah/watt-activation/part-221
  5. [5]Part 2192 facts
    ctx:discord/blah/watt-activation/part-219
  6. [6]Part 2404 facts
    ctx:discord/blah/watt-activation/part-240
  7. [7]Part 2661 fact
    ctx:discord/blah/watt-activation/part-266
  8. [8]Part 2621 fact
    ctx:discord/blah/watt-activation/part-262
  9. [9]Part 31715 facts
    ctx:discord/blah/watt-activation/part-317
  10. [10]Part 3224 facts
    ctx:discord/blah/watt-activation/part-322
  11. [11]Part 3382 facts
    ctx:discord/blah/watt-activation/part-338
  12. [12]Part 2152 facts
    ctx:discord/blah/watt-activation/part-215
  13. [13]Part 31926 facts
    ctx:discord/blah/watt-activation/part-319
  14. [14]2053 facts
    ctx:discord/blah/watt-activation/205
    • full textwatt-activation-205
      text/plain2 KBdoc:agent/watt-activation-205/9ef261de-33ef-4e77-a9ad-af07b253a5ab
      Show excerpt
      [2026-03-11 03:09] lisamegawatts: <@1438866165475708979> how would you explain to a claude that proposed this why it is wrong: ⏺ Running in mac-mini:smoketest-4. While that runs — the coupling gradient is still wrong because K_target = (d-r
  15. [15]2142 facts
    ctx:discord/blah/watt-activation/214
    • full textwatt-activation-214
      text/plain2 KBdoc:agent/watt-activation-214/6ebedb80-7ad3-4d5e-8432-4c87da7e9ad5
      Show excerpt
      [2026-03-11 04:17] xenonfun: ``` Model: lohe_spherical+lohe_v3 768d 12L 12H vocab=100277 Steps: 1000 BS=4 SEQ=1024 (4.1M tokens/run) Phase metrics sidecar → logs/phase_metrics_lohe_spherical_20260311_001319.jsonl ====================
  16. [16]2182 facts
    ctx:discord/blah/watt-activation/218
    • full textwatt-activation-218
      text/plain2 KBdoc:agent/watt-activation-218/8c31d20c-8693-4814-8ac3-e83806d6ce35
      Show excerpt
      [2026-03-11 04:40] xenonfun: --- Run 2: lohe_spherical+lohe_v3+RotAdamW (1000 steps) Network-level: global_r≈0.107, β≈25, β_gate flat at 0.119. Notably flatter than spectral. ``` ┌─────┬───────────────────┬───────────┬─────────────┬─
  17. [17]2205 facts
    ctx:discord/blah/watt-activation/220
    • full textwatt-activation-220
      text/plain3 KBdoc:agent/watt-activation-220/5c7f4a28-90e7-46de-ae1e-9e19a58c8d65
      Show excerpt
      [2026-03-11 04:42] xenonfun: FFN DFT — much richer specialization than spectral: ``` ┌─────┬───────┬────────┬────────────────┬────────────────┐ │ blk │ r │ FFN DC │ dominant mode │ pattern │ ├─────┼───────┼────────┼───────
  18. [18]2392 facts
    ctx:discord/blah/watt-activation/239
    • full textwatt-activation-239
      text/plain2 KBdoc:agent/watt-activation-239/03c6b99f-ab23-4b61-9a54-de6446a05b4f
      Show excerpt
      [2026-03-12 02:29] lisamegawatts: oh also the phases matter more [2026-03-12 02:29] xenonfun: will ask for dashboard comparing the 3 phase data now [2026-03-12 02:31] xenonfun: ``` Mode: raw temp=0.8 top_k=40 rep_penalty=1.1 stop=eos=1
  19. [19]2372 facts
    ctx:discord/blah/watt-activation/237
    • full textwatt-activation-237
      text/plain3 KBdoc:agent/watt-activation-237/ff57ddeb-496d-4aef-ba0b-3e68ef5cac46
      Show excerpt
      [2026-03-12 01:34] xenonfun: forgot we also have the more "pure" lohespherical attention so running that for full epic. ``` Phase metrics sidecar → logs/phase_metrics_lohe_spherical_20260311_213344.jsonl [model] lohe_spherical+lohe_v3 832
  20. [20]3157 facts
    ctx:discord/blah/watt-activation/315
    • full textwatt-activation-315
      text/plain2 KBdoc:agent/watt-activation-315/5f801374-2b73-4ce9-bd06-bdb14c70d743
      Show excerpt
      [2026-03-15 01:50] xenonfun: ``` ⏺ Attention Type Comparison (200 steps, d=768, 12L, 12H, compiled) ┌────────────────┬──────┬───────┬────────┬────────┬─────────┐ │ Attention │ Loss │ PPL │ Tok/s │ Params │ PPL/tok │ ├────────
  21. [21]3203 facts
    ctx:discord/blah/watt-activation/320
    • full textwatt-activation-320
      text/plain2 KBdoc:agent/watt-activation-320/eea07d79-9c10-47fa-bc4c-f80d8bf89bcb
      Show excerpt
      [2026-03-15 03:05] xenonfun: ``` ⏺ Done. Full modulation spectrum: Robustness ←────────────────────────────────→ Density bpsk qpsk 8psk 16qam 256qam 8 sym/byte 4 sym/byte 3 sym/byte 2 sym/byte 1 sym/byte 16
  22. [22]3361 fact
    ctx:discord/blah/watt-activation/336
    • full textwatt-activation-336
      text/plain3 KBdoc:agent/watt-activation-336/04f318bf-4029-460c-b2ce-82900263e51e
      Show excerpt
      [2026-03-15 15:12] xenonfun: ⏺ Step 2000 results (bs=512 seq=256 (its pointless to use higher bandwidth cuts off hurts quality of mappings beyond this)) so trying optimal run, high BS smooth out variance considerable. Eval (mixed_bytes v

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.