LatentMoE
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
LatentMoE has 30 facts recorded in Dontopedia across 3 references, with 4 live disagreements.
Mostly:combines component(4), combines(4), expert type(3)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (1)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
targetForIntegrationTarget for Integration(1)
- Harmonic Blocks
ex:harmonic-blocks
Other facts (28)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Combines Component | Attention Mechanism | [1] |
| Combines Component | Mamba 2 | [1] |
| Combines Component | Mixture of Experts Moe | [1] |
| Combines Component | Multi Token Prediction Mtp | [1] |
| Combines | Mixture of Experts | [2] |
| Combines | Mamba 2 | [2] |
| Combines | Attention Mechanism | [2] |
| Combines | Multi Token Prediction | [2] |
| Expert Type | Latentlohe | [3] |
| Expert Type | Spectral | [3] |
| Expert Type | Attention | [3] |
| Is Hybrid Sequence Model | true | [1] |
| Is Hybrid Sequence Model | true | [2] |
| Rdf:type | Model | [2] |
| Rdf:type | Neural Network Architecture | [3] |
| Operates in | Latent Space | [1] |
| Exists As Model | true | [1] |
| Operates in Latent Space | true | [2] |
| Routing Strategy | sparse-routing | [3] |
| Sparse Sense | closer to "sparse" in the modern sense | [3] |
| Test Count | 24 | [3] |
| Has Mo E Router | true | [3] |
| Has Mtp Head | true | [3] |
| Integration Potential | Waveunified Blocks | [3] |
| Integration Mechanism | Block to Expert Transformation | [3] |
| Scaling Axis | sparse activation | [3] |
| Estimated Port Effort | ~2-3 days | [3] |
| Port Effort Condition | Mtp Head Inclusion | [3] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (3)
ctx:discord/blah/watt-activation/part-448ctx:discord/blah/watt-activation/446- full textwatt-activation-446text/plain3 KB
doc:agent/watt-activation-446/f0ca57f6-5ee0-47fe-be17-374fd38df4fdShow excerpt
[2026-03-20 21:08] xenonfun: ``` The impact ranking from today: 1. Phase coupling (DYN-H4): 2.103 → 2.096 BPB, +1.5dB SNR, +33% capacity — biggest win 2. seq=128 (match receptive field): ~2.1 → ~1.9 BPB — huge, but config not archite…
ctx:discord/blah/watt-activation/693- full textwatt-activation-693text/plain3 KB
doc:agent/watt-activation-693/8372b985-fcfe-4f68-a730-4cd9d14a0fb9Show excerpt
[2026-04-28 23:22] xenonfun: KickModel (sparse extreme — top pick for fast iteration) 25 params total at g=8 (yes, twenty-five). BPB 2.04 on fineweb. Architecture: ∂ₜΨ = [Ω, Ψ] − γ⟨Ψ⟩ + kick, G independent S³ oscillators (3G+1 params), exp…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.