Standard Transformers
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Standard Transformers has 5 facts recorded in Dontopedia across 3 references.
Mostly:lack(1), pass information between layers through(1), has kv cache growth(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (3)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
fitsBetterThanForFits Better Than for(1)
- Ternary 1 58 Bit Model
ex:ternary-1-58-bit-model
isOnlyChannelInIs Only Channel in(1)
- Residual Stream
ex:residual-stream
lacksKvCacheProblemLacks Kv Cache Problem(1)
- Linear Attention
ex:linear-attention
Other facts (5)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Lack | Second Channel | [1] |
| Pass Information Between Layers Through | Residual Stream | [1] |
| Has Kv Cache Growth | Context Length | [2] |
| Suffers Memory Wall | Kv Cache | [2] |
| Negatively Affected by | Gb10 Hardware Bandwidth | [3] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (3)
ctx:discord/blah/watt-activation/part-65ctx:discord/blah/watt-activation/part-126ctx:discord/blah/watt-activation/689- full textwatt-activation-689text/plain3 KB
doc:agent/watt-activation-689/93398fc1-11ca-43fc-aa88-201922326b02Show excerpt
[2026-04-28 08:30] xenonfun: ``` What I'd actually prototype: A small Clifford SSM — state space model where the state transition matrix is replaced by rotor conjugation in Cl(3,0) or Cl(4,0) (smaller than 6,0 for a first experiment). Compa…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.