lohe_spherical
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
lohe_spherical has 102 facts recorded in Dontopedia across 22 references, with 5 live disagreements.
Mostly:has ppl at step(7), rdf:type(7), has perplexity(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (30)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
usesAttentionUses Attention(2)
- Harmonic Gpt
ex:harmonic-gpt - Lohe Decoder D512 L6
ex:lohe-decoder-d512-l6
adaptsToAttentionTypeAdapts to Attention Type(1)
- Lohe Optimizer
ex:lohe-optimizer
advocatesSphericalAdvocates Spherical(1)
- Xenonfun
ex:xenonfun
assumesSharedKnowledgeAssumes Shared Knowledge(1)
- Chat Context
ex:chat-context
behindBehind(1)
- Current Bpb
ex:current-bpb
claimsComponentHasLowerPerplexityClaims Component Has Lower Perplexity(1)
- Message 0418
ex:message-0418
claimsComponentIsFasterClaims Component Is Faster(1)
- Message 0418
ex:message-0418
claimsTradeoffIsOffsetClaims Tradeoff Is Offset(1)
- Message 0418
ex:message-0418
comparedToCompared to(1)
- Topo Anchor Kan Quality Advantage
ex:topo-anchor-kan-quality-advantage
comparesUnfavorablyToCompares Unfavorably to(1)
- Model Training Process
ex:model-training-process
convergesIdenticallyToConverges Identically to(1)
- Spectral
ex:spectral
dependsOnDepends on(1)
- Phase Metrics Sidecar
ex:phase-metrics-sidecar
describesDescribes(1)
- Lohe Spherical Speed Advantage
ex:lohe-spherical-speed-advantage
evaluatedSuperiorEvaluated Superior(1)
- Complex Attention
ex:complex-attention
has4_3xBetterPPLThanHas4 3x Better Ppl Than(1)
- Topo Anchor Kan
ex:topo-anchor-kan
hasAttentionTypeHas Attention Type(1)
- Lohe Spherical Plus Jacobi
ex:lohe-spherical-plus-jacobi
hasLowerLossThanHas Lower Loss Than(1)
- Topo Star Plus Kan
ex:topo-star-plus-kan
hasSameModelQualityAsHas Same Model Quality As(1)
- Spectral
ex:spectral
hasSyncHubRoleForConfigHas Sync Hub Role for Config(1)
- Block 10
ex:block-10
involvesComponentInvolves Component(1)
- D512 Configuration
ex:d512-configuration
mentionsModelMentions Model(1)
- Message 2026 03 12 01 34
ex:message-2026-03-12-01-34
needsDesignAfterResultsNeeds Design After Results(1)
- Feedback Mechanism
ex:feedback-mechanism
refersToSpecificAttentionRefers to Specific Attention(1)
- Lohe
ex:lohe
subjectSubject(1)
- Lohe Spherical Strictly Better
ex:lohe-spherical-strictly-better
subject2Subject2(1)
- Spectral Lohe Identical Convergence
ex:spectral-lohe-identical-convergence
suggestsSuggests(1)
- Recommendation Fast
ex:recommendation-fast
usedWithUsed With(1)
- D 512
ex:d-512
usesConfigUses Config(1)
- Run 2
ex:run-2
usesMethodUses Method(1)
- Experiment Lohe Spherical Lohe V2
ex:experiment-lohe-spherical-lohe-v2
Other facts (95)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Has Ppl at Step | 1567 | [13] |
| Has Ppl at Step | 517 | [13] |
| Has Ppl at Step | 449 | [13] |
| Has Ppl at Step | 335 | [13] |
| Has Ppl at Step | 216 | [13] |
| Has Ppl at Step | 190 | [13] |
| Has Ppl at Step | 210 | [13] |
| Rdf:type | Experiment | [14] |
| Rdf:type | Model Component | [15] |
| Rdf:type | Attention Configuration | [17] |
| Rdf:type | Model | [18] |
| Rdf:type | Model Architecture | [19] |
| Rdf:type | Attention Type | [20] |
| Rdf:type | Component | [21] |
| Has Perplexity | 97 | [6] |
| Has Perplexity | 8225 | [20] |
| Combined With | Lohe V3 | [7] |
| Combined With | Lohe V3 | [10] |
| Has Param Count | 93.5M | [9] |
| Has Param Count | 93500000 | [20] |
| Has Tokens Per Second | 16043 | [9] |
| Has Tokens Per Second | 16043 | [20] |
| Has Loss | 9.01 | [9] |
| Has Loss | 9.01 | [20] |
| Results Pending | true | [1] |
| Is Attention Variant | Lohe V2 | [2] |
| Reduces Qk Params Vs | Spectralattn | [2] |
| Has Simpler Attention Mechanism Than | Spectralattn | [2] |
| Has Fewer Params in Qk | 32x768 | [2] |
| Has Gh | 32 | [3] |
| Has Dmodel | 768 | [3] |
| Keeps V at | full d_model=768 across GH=32 spectral channels | [3] |
| Has D | 768 | [3] |
| Optimizes Qk But Not V | true | [3] |
| Has Kv Inp Shape | (B, T, GH=32, D=768) | [3] |
| Achieves Only | ~60% | [4] |
| Has Weaker Sync | Spectral | [4] |
| Underperforms | Spectral | [4] |
| Has DC Mode | 0.148 | [4] |
| Has Sync Hub | Block 10 | [4] |
| Has Tok S | 14000 | [4] |
| Has R Hub | 0.385 | [4] |
| Uses Ring Topology | null | [5] |
| Gets Partially There | null | [5] |
| Outperforms Others | Competitors | [6] |
| Superior in | Perplexity Metric | [6] |
| Wins by Margin | Big Margin | [6] |
| Is Model Architecture | Training Setup | [8] |
| Uses Fewest Parameters | null | [9] |
| Might Catch Up With More Steps | null | [9] |
| Has Ppl Per Token | 0.51 | [9] |
| Is Strictly Better Than | Spectral | [9] |
| Is Speed King | true | [9] |
| References Lohe Method | null | [9] |
| Is25 Percent Faster Than | Spectral | [9] |
| Is2 25x Faster Than | Topo Anchor Kan | [9] |
| Has Ppl | 8225 | [9] |
| Excels in Inference Speed | null | [9] |
| Recommended for | fast iteration/long training | [9] |
| Has13 Percent Fewer Params Than | Spectral | [9] |
| Ontologically Efficient | D 512 | [10] |
| Causes Fewer Params | Attention Projections | [10] |
| Parameter Efficient at | 512 | [10] |
| Is Prior Model | true | [11] |
| Achieves Bpb | 2.52 | [11] |
| Was Faster | Previous Config | [12] |
| Has Less Ppl Per Step | Previous Config | [12] |
| Wins in Ppl | null | [13] |
| Benefits More From | Strong Rotational Dynamics | [13] |
| Has27 Percent Fewer Params Than | Spectral | [13] |
| Has Fewest Params | null | [13] |
| Has Final Ppl | 210 | [13] |
| Has Lower Ppl Than Spectral At1000 | null | [13] |
| Has Params | 12.3M | [13] |
| Has Tok Per S | 83777 | [13] |
| Is3 2 Times Faster Than | Star Kan | [13] |
| Is47 Percent Faster Than | Spectral | [13] |
| Is Fastest | null | [13] |
| Maintains Lead Throughout | null | [13] |
| Overtakes | Spectral | [13] |
| Overtakes at Step | 200 | [13] |
| Preferred by Author | null | [13] |
| Superior in All Metrics | null | [13] |
| Uses Lohe Sync | null | [13] |
| Uses O T Cumsum Recurrence | null | [13] |
| Wins Everything | null | [13] |
| Status | pending | [14] |
| Reaches State Partially | DC Kuramoto State | [16] |
| Has Sync Strength Magnitude | 0.6 | [17] |
| Has Baseline Throughput | 14000 | [17] |
| Has Throughput Unit | Tok S | [17] |
| Has Ppl Per Token | 0.51 | [20] |
| Property | parameter-efficient | [21] |
| Component Name | lohe_spherical+lohe_v3 | [21] |
| Has Bpb | 2.52 | [22] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (22)
ctx:discord/blah/watt-activation/part-206ctx:discord/blah/watt-activation/part-204ctx:discord/blah/watt-activation/part-202ctx:discord/blah/watt-activation/part-221ctx:discord/blah/watt-activation/part-219ctx:discord/blah/watt-activation/part-240ctx:discord/blah/watt-activation/part-266ctx:discord/blah/watt-activation/part-262ctx:discord/blah/watt-activation/part-317ctx:discord/blah/watt-activation/part-322ctx:discord/blah/watt-activation/part-338ctx:discord/blah/watt-activation/part-215ctx:discord/blah/watt-activation/part-319ctx:discord/blah/watt-activation/205- full textwatt-activation-205text/plain2 KB
doc:agent/watt-activation-205/9ef261de-33ef-4e77-a9ad-af07b253a5abShow excerpt
[2026-03-11 03:09] lisamegawatts: <@1438866165475708979> how would you explain to a claude that proposed this why it is wrong: ⏺ Running in mac-mini:smoketest-4. While that runs — the coupling gradient is still wrong because K_target = (d-r…
ctx:discord/blah/watt-activation/214- full textwatt-activation-214text/plain2 KB
doc:agent/watt-activation-214/6ebedb80-7ad3-4d5e-8432-4c87da7e9ad5Show excerpt
[2026-03-11 04:17] xenonfun: ``` Model: lohe_spherical+lohe_v3 768d 12L 12H vocab=100277 Steps: 1000 BS=4 SEQ=1024 (4.1M tokens/run) Phase metrics sidecar → logs/phase_metrics_lohe_spherical_20260311_001319.jsonl ====================…
ctx:discord/blah/watt-activation/218- full textwatt-activation-218text/plain2 KB
doc:agent/watt-activation-218/8c31d20c-8693-4814-8ac3-e83806d6ce35Show excerpt
[2026-03-11 04:40] xenonfun: --- Run 2: lohe_spherical+lohe_v3+RotAdamW (1000 steps) Network-level: global_r≈0.107, β≈25, β_gate flat at 0.119. Notably flatter than spectral. ``` ┌─────┬───────────────────┬───────────┬─────────────┬─…
ctx:discord/blah/watt-activation/220- full textwatt-activation-220text/plain3 KB
doc:agent/watt-activation-220/5c7f4a28-90e7-46de-ae1e-9e19a58c8d65Show excerpt
[2026-03-11 04:42] xenonfun: FFN DFT — much richer specialization than spectral: ``` ┌─────┬───────┬────────┬────────────────┬────────────────┐ │ blk │ r │ FFN DC │ dominant mode │ pattern │ ├─────┼───────┼────────┼───────…
ctx:discord/blah/watt-activation/239- full textwatt-activation-239text/plain2 KB
doc:agent/watt-activation-239/03c6b99f-ab23-4b61-9a54-de6446a05b4fShow excerpt
[2026-03-12 02:29] lisamegawatts: oh also the phases matter more [2026-03-12 02:29] xenonfun: will ask for dashboard comparing the 3 phase data now [2026-03-12 02:31] xenonfun: ``` Mode: raw temp=0.8 top_k=40 rep_penalty=1.1 stop=eos=1 …
ctx:discord/blah/watt-activation/237- full textwatt-activation-237text/plain3 KB
doc:agent/watt-activation-237/ff57ddeb-496d-4aef-ba0b-3e68ef5cac46Show excerpt
[2026-03-12 01:34] xenonfun: forgot we also have the more "pure" lohespherical attention so running that for full epic. ``` Phase metrics sidecar → logs/phase_metrics_lohe_spherical_20260311_213344.jsonl [model] lohe_spherical+lohe_v3 832…
ctx:discord/blah/watt-activation/315- full textwatt-activation-315text/plain2 KB
doc:agent/watt-activation-315/5f801374-2b73-4ce9-bd06-bdb14c70d743Show excerpt
[2026-03-15 01:50] xenonfun: ``` ⏺ Attention Type Comparison (200 steps, d=768, 12L, 12H, compiled) ┌────────────────┬──────┬───────┬────────┬────────┬─────────┐ │ Attention │ Loss │ PPL │ Tok/s │ Params │ PPL/tok │ ├────────…
ctx:discord/blah/watt-activation/320- full textwatt-activation-320text/plain2 KB
doc:agent/watt-activation-320/eea07d79-9c10-47fa-bc4c-f80d8bf89bcbShow excerpt
[2026-03-15 03:05] xenonfun: ``` ⏺ Done. Full modulation spectrum: Robustness ←────────────────────────────────→ Density bpsk qpsk 8psk 16qam 256qam 8 sym/byte 4 sym/byte 3 sym/byte 2 sym/byte 1 sym/byte 16…
ctx:discord/blah/watt-activation/336- full textwatt-activation-336text/plain3 KB
doc:agent/watt-activation-336/04f318bf-4029-460c-b2ce-82900263e51eShow excerpt
[2026-03-15 15:12] xenonfun: ⏺ Step 2000 results (bs=512 seq=256 (its pointless to use higher bandwidth cuts off hurts quality of mappings beyond this)) so trying optimal run, high BS smooth out variance considerable. Eval (mixed_bytes v…
See also
- Lohe V2
- Spectralattn
- Spectral
- Block 10
- Competitors
- Perplexity Metric
- Big Margin
- Lohe V3
- Training Setup
- Topo Anchor Kan
- D 512
- Attention Projections
- Previous Config
- Strong Rotational Dynamics
- Star Kan
- Experiment
- Model Component
- DC Kuramoto State
- Attention Configuration
- Tok S
- Model
- Model Architecture
- Attention Type
- Component
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.