Lohe
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
sameAs to 1 other subject: LoheattentionReview & merge →Lohe has 48 facts recorded in Dontopedia across 21 references, with 3 live disagreements.
Mostly:has strength(5), rdf:type(2), is target model(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (17)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
marksAsLegacyMarks As Legacy(2)
- Architecture Md Line 43
ex:architecture-md-line-43 - Lohe Ffn Py Line 162
ex:lohe-ffn-py-line-162
appliesToApplies to(1)
- No Attention Claim
ex:no-attention-claim
appliesToProjectionOntoApplies to Projection Onto(1)
- Switching From Tokens to Harmonics Phases
ex:switching-from-tokens-to-harmonics-phases
contrastsWithContrasts With(1)
- Vq
ex:vq
excitesBecauseFitsExistingExcites Because Fits Existing(1)
- Quaternion Mode
ex:quaternion-mode
fromRunOnFrom Run on(1)
- Phase Metrics 20260309 225648 Jsonl
ex:phase-metrics-20260309-225648-jsonl
hasMemberHas Member(1)
- Spsa Lohe Group
ex:spsa-lohe-group
isKindaThePointIs Kinda the Point(1)
- Learned Positional Embeddings
ex:learned-positional-embeddings
mapsToMaps to(1)
- Su 2
ex:su-2
namedAfterLoheNamed After Lohe(1)
- Loheoptimizer
ex:loheoptimizer
precedesInTransitionPrecedes in Transition(1)
- Kuramoto
ex:kuramoto
referencesLoheGatedStateReferences Lohe Gated State(1)
- Text
ex:text
referencesSpecificArchitectureReferences Specific Architecture(1)
- Lohe Architecture
ex:lohe-architecture
referencesStructuredCouplingReferences Structured Coupling(1)
- Codex
ex:codex
requiresPhaseSynchronizationRequires Phase Synchronization(1)
- Training
ex:training
triggersOnTopicTriggers on Topic(1)
- Monumental Mlx Expert Skill
ex:monumental-mlx-expert-skill
Other facts (45)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Has Strength | better physical inductive bias | [17] |
| Has Strength | manifold-native dynamics | [17] |
| Has Strength | field / transport style memory | [17] |
| Has Strength | parallel-friendly O(n) structure | [17] |
| Has Strength | coherence-driven gating | [17] |
| Rdf:type | Software Component | [19] |
| Rdf:type | Code Branch | [20] |
| Is Target Model | null | [1] |
| Involves Sphere Attention | F687875 | [2] |
| Supports Cached Decode | E081b1e | [2] |
| Underperforms Random | Random Chance | [3] |
| Achieves Loss Of14 | 14 | [3] |
| Runs But Does Not Converge | true | [3] |
| Vs Unigram Real | 9.22 | [4] |
| Vs Uniform | 6.87 | [4] |
| Needs More Perturbations or Smaller Model | To Work Effectively | [4] |
| Much Worse Than Uniform | Uniform | [4] |
| Loss After100 Iters | 15.8605 | [4] |
| Historical Optimizer | Synchronization | [4] |
| Is Linearized As | proj_in → (zero-pad to readout_dim) → readout | [5] |
| Above Noise Level | might still be | [6] |
| Doing Something | finally | [6] |
| Commits to Cross Layer Sync | null | [7] |
| Has Sync on Qk | ~2ms total | [7] |
| Part of Config Names | Multiple Runs | [8] |
| Specifies Approach | Phases Chords | [9] |
| Has | Frequency Basis | [10] |
| Has Basis in | Frequency | [10] |
| Presupposes | Gradient Flow Principle | [10] |
| Is Marked Legacy Deprecated | null | [11] |
| Operates by | Emerge by Synchronization | [12] |
| Enables Emergence of | Code Like Direction | [12] |
| Is Mentioned Topic | Project Term | [13] |
| Causes Loss of | Magnitude | [14] |
| Loses | Magnitude | [14] |
| Style of Coupling | null | [15] |
| Part of | Quantum Sync Chain | [16] |
| Maps to | Lohe Schrodinger | [16] |
| Provides Better Physical Inductive Bias | null | [17] |
| Refers to Specific Attention | Lohe Spherical | [18] |
| Marked As | legacy/deprecated | [20] |
| Same As | Loheattention | [21] |
| Has Parameter Count | 341730 | [21] |
| Has Bpb | 3.278 | [21] |
| Has Iterations Per Second | 14.9 | [21] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (21)
ctx:discord/blah/watt-activation/part-66ctx:discord/blah/watt-activation/part-68ctx:discord/blah/watt-activation/part-118ctx:discord/blah/watt-activation/part-119ctx:discord/blah/watt-activation/part-179ctx:discord/blah/watt-activation/part-186ctx:discord/blah/watt-activation/part-203ctx:discord/blah/watt-activation/part-220ctx:discord/blah/watt-activation/part-254ctx:discord/blah/watt-activation/part-256ctx:discord/blah/watt-activation/part-261ctx:discord/blah/watt-activation/part-309ctx:discord/blah/watt-activation/part-311ctx:discord/blah/watt-activation/part-321ctx:discord/blah/watt-activation/part-472ctx:discord/blah/watt-activation/part-573ctx:discord/blah/watt-activation/part-604ctx:discord/blah/watt-activation/part-304ctx:discord/blah/watt-activation/119- full textwatt-activation-119text/plain3 KB
doc:agent/watt-activation-119/dd015076-4b38-4017-9483-3f91bdce858dShow excerpt
[2026-03-09 00:25] xenonfun: okay at least generating something probablt still some bugs. ⏺ Committed and pushed. Key things done this session: 1. docs/symbiogenesis.md saved as a core document, linked prominently from CLAUDE.md 2. Roo…
ctx:discord/blah/watt-activation/259- full textwatt-activation-259text/plain3 KB
doc:agent/watt-activation-259/b2e296e0-fb4d-4e37-8eb5-edb6b6f98d8dShow excerpt
[2026-03-12 20:52] ajaxdavis: they got a frontend role, im gonna apply for my own made up role on their behalf somewhere in between [2026-03-12 21:10] xenonfun: its pretty rough at visuals, forgetting axis labels other things but it works w…
ctx:discord/blah/watt-activation/640- full textwatt-activation-640text/plain2 KB
doc:agent/watt-activation-640/a18a3544-564d-4594-b373-0eb924570710Show excerpt
[2026-04-16 01:36] lisamegawatts: Task Completed The Wave Native LM bakeoff comparing LoheAttention vs LinearKAN has completed. WAVE NATIVE LM BAKEOFF RESULTS Model Params BPB it/s linear_kan 492,174 3.116 4.22 lohe 3…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.