Complex attention (lohe_complex)
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Complex attention (lohe_complex) has 7 facts recorded in Dontopedia across 4 references, with 1 live disagreement.
Mostly:is better attention variant for(2), rdf:type(2), most likely causes(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (3)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
hasAttentionTypeHas Attention Type(1)
- Lohe Complex Plus Jacobi
ex:lohe-complex-plus-jacobi
implementsVariantImplements Variant(1)
- Complex Attention
ex:complex-attention
usesVariantUses Variant(1)
- Current Model Run
ex:current-model-run
Other facts (6)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Is Better Attention Variant for | Wire Encoding | [2] |
| Is Better Attention Variant for | Wire Encoding | [3] |
| Rdf:type | Attention Variant | [3] |
| Rdf:type | Feature | [4] |
| Most Likely Causes | 0 7 Bpb Improvement | [1] |
| Status | tested | [4] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (4)
ctx:discord/blah/watt-activation/part-336ctx:discord/blah/watt-activation/part-337ctx:discord/blah/watt-activation/335- full textwatt-activation-335text/plain2 KB
doc:agent/watt-activation-335/dd79a73c-09f4-4ca4-992c-61e51914a192Show excerpt
[2026-03-15 14:31] xenonfun: ⏺ 8.40M params — essentially the same as the lohe_spherical run (8.45M). Same model size, same data shape, but lohe_complex + SEQ=256 reached ppl=6.1 in 855 steps vs 40,000 steps. That's a ~47× faster converg…
ctx:discord/blah/watt-activation/475- full textwatt-activation-475text/plain2 KB
doc:agent/watt-activation-475/e1172583-2318-4515-b9d4-b2208603f689Show excerpt
[2026-03-21 20:42] xenonfun: ``` ⏺ Clean tree, all pushed. Here's the full session summary: Session Summary: 15 commits, ~20K new lines FedSym Evolutionary Framework (complete): - 15 modules: config, activation, unit, training, fusi…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.