Resonance Attention

as donto believed on

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Resonance Attention

Rdf:type	Attention Class^[8]
Rdf:type	Attention Mechanism^[10]
Rdfs:label	ResonanceAttention^[8]
Rdfs:label	resonance (Kuramoto)^[10]
Has Method	Forward Method^[6]
Has Method	Step Method^[6]
Has Messy State Handling	6 State Keys^[7]
Does Not Accept Parameter	Gate Init^[2]
Located at Lines	574, 630, 682^[2]
Has Limitation for O1 Generation Quality	true^[3]
Has Compilation Issue	Python Loop^[5]

ex:resonance-attention

Resonance Attention has 37 facts recorded in Dontopedia across 10 references, with 3 live disagreements.

37 facts·31 predicates·10 sources·3 in dispute

Mostly:rdf:type(4), rdfs:label(3), has method(2)

Rdf:typein dispute`rdf:type`

Attention Class^[8]all time · 158
Attention Mechanism^[10]all time · 103
Code Module^[1]all time · 105
Software Component^[6]all time · 106

Rdfs:labelin dispute`rdfs:label`

ResonanceAttention^[8]all time · 158
resonance (Kuramoto)^[10]sourceall time · 103
ResonanceAttention^[1]sourceall time · 105

Has Methodin dispute`hasMethod`

Forward Method^[6]sourceall time · 106
Step Method^[6]sourceall time · 106

Has Messy State Handling`hasMessyStateHandling`

6 State Keys^[7]all time · Part 158

Does Not Accept Parameter`doesNotAcceptParameter`

Gate Init^[2]all time · Part 108

Located at Lines`locatedAtLines`

574, 630, 682^[2]all time · Part 108

Has Limitation for O1 Generation Quality`hasLimitationForO1GenerationQuality`

true^[3]all time · Part 109

Has Compilation Issue`hasCompilationIssue`

Python Loop^[5]all time · Part 105

Has Python Loop Over`hasPythonLoopOver`

K Bands^[5]all time · Part 105

Uses Ema Accumulation`usesEMAAccumulation`

Ema^[5]all time · Part 105

Uses Kuramoto Phase Sync`usesKuramotoPhaseSync`

Kuramoto^[5]all time · Part 105

Had Bugs From Reference`hadBugsFromReference`

Reference Implementation^[4]all time · Part 107

Inbound mentions (8)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

`assumesAudienceKnowledgeOfCodebase`Assumes Audience Knowledge of Codebase(1)

Review Summaryex:review-summary

`confirmCorrectness`Confirm Correctness(1)

Testsex:tests

`describesMakeAttentionPassingGateInit`Describes Make Attention Passing Gate Init(1)

Make Attention Gate Init Issueex:make-attention-gate-init-issue

`hasAttentionType`Has Attention Type(1)

Session 2026 03 21ex:session-2026-03-21

`implementsAttentionType`Implements Attention Type(1)

Rust Projectex:rust-project

`includeResonanceAttention`Include Resonance Attention(1)

Attention Classesex:attention-classes

`includesResonanceAttention`Includes Resonance Attention(1)

Attention Variantsex:attention-variants

`usesAttentionMechanism`Uses Attention Mechanism(1)

Harmonic Gptex:harmonic-gpt

Other facts (19)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

19 facts

Predicate	Value	Ref
Removed Hardcoded Astype	Mx Float32	[4]
Implicates Training Issue	null	[9]
References Attention Variant	null	[9]
Has Forward Method	uses x.dtype	[2]
Exists As Component	true	[3]
Requires Restructuring	Vectorize Over Bands	[5]
Presupposes Bugs Existed	Reference Implementation	[4]
Has Property	Messier State	[8]
Has Issue	Step Forward Mismatch	[6]
Description	Kuramoto phase sync + EMA accumulation	[1]
Requires Restructuring for	Vectorization	[1]
Has Loop Body Property	Variable Indexing	[1]
Incompatible With	Mx Compile Feature	[1]
Iterates Over	K Bands	[1]
Implements Python Loop	true	[1]
Has Code Location	Lines 857 877	[1]
Quality Adjusted Tokens Per Second	4700	[10]
Tokens Per Second	175000	[10]
Perplexity Score	7.89	[10]

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

37 undated

—

descriptionblah/watt-activation/105

Kuramoto phase sync + EMA accumulation

—

doesNotAcceptParameterblah/watt-activation/part-108

ex:gate-init

—

existsAsComponentblah/watt-activation/part-109

true

—

hadBugsFromReferenceblah/watt-activation/part-107

ex:reference-implementation

—

hasCodeLocationblah/watt-activation/105

ex:lines-857-877

—

hasCompilationIssueblah/watt-activation/part-105

ex:python-loop

—

hasForwardMethodblah/watt-activation/part-108

uses x.dtype

—

hasIssueblah/watt-activation/106

ex:step-forward-mismatch

—

hasLimitationForO1GenerationQualityblah/watt-activation/part-109

true

—

hasLoopBodyPropertyblah/watt-activation/105

ex:variable-indexing

—

hasMessyStateHandlingblah/watt-activation/part-158

ex:6-state-keys

—

hasMethodblah/watt-activation/106

ex:forward-method

—

hasMethodblah/watt-activation/106

ex:step-method

—

hasPropertyblah/watt-activation/158

ex:messier-state

—

hasPythonLoopOverblah/watt-activation/part-105

ex:k-bands

—

implementsPythonLoopblah/watt-activation/105

true

—

implicatesTrainingIssueblah/watt-activation/part-111

null

—

incompatibleWithblah/watt-activation/105

ex:mx-compile-feature

—

iteratesOverblah/watt-activation/105

ex:k-bands

—

locatedAtLinesblah/watt-activation/part-108

574, 630, 682

—

perplexityScoreblah/watt-activation/103

7.89

—

presupposesBugsExistedblah/watt-activation/part-107

ex:reference-implementation

—

qualityAdjustedTokensPerSecondblah/watt-activation/103

4700

—

labelblah/watt-activation/158

ResonanceAttention

—

labelblah/watt-activation/103

resonance (Kuramoto)

—

labelblah/watt-activation/105

ResonanceAttention

—

typeblah/watt-activation/158

ex:AttentionClass

—

typeblah/watt-activation/103

ex:AttentionMechanism

—

typeblah/watt-activation/105

ex:CodeModule

—

typeblah/watt-activation/106

ex:SoftwareComponent

—

referencesAttentionVariantblah/watt-activation/part-111

null

—

removedHardcodedAstypeblah/watt-activation/part-107

ex:mx-float32

—

requiresRestructuringblah/watt-activation/part-105

ex:vectorize-over-bands

—

requiresRestructuringForblah/watt-activation/105

ex:vectorization

—

tokensPerSecondblah/watt-activation/103

175000

—

usesEMAAccumulationblah/watt-activation/part-105

ex:ema

—

usesKuramotoPhaseSyncblah/watt-activation/part-105

ex:kuramoto

References (10)

10 references

[1]watt-activation-1059 facts
customctx:discord/blah/watt-activation/105
- full textwatt-activation-105
  text/plain3 KBdoc:agent/watt-activation-105/561920dc-7f65-4ab4-80fa-8e3162aa9046
  Show excerpt
  [2026-03-08 19:26] xenonfun: ``` What They're Leaving on the Table 1. No mx.compile — Their benchmark and model run eagerly. From our experience with AnchorKAN at similar scale, compiled step gives ~1.5-2x throughput improvement on M…
[2]Part 1083 facts
customctx:discord/blah/watt-activation/part-108
[3]Part 1092 facts
customctx:discord/blah/watt-activation/part-109
[4]Part 1073 facts
customctx:discord/blah/watt-activation/part-107
[5]Part 1055 facts
customctx:discord/blah/watt-activation/part-105
[6]watt-activation-1064 facts
customctx:discord/blah/watt-activation/106
- full textwatt-activation-106
  text/plain3 KBdoc:agent/watt-activation-106/1cc0dbfa-458e-4f02-b7b6-1c37e3d3a7f8
  Show excerpt
  [2026-03-08 19:52] xenonfun: ``` total used free wired compressed 98304Mi 88429Mi 8982Mi 59988Mi 100Mi ``` (files: Screenshot_2026-03-08_at_3.52.13_PM.png) [2026-03-08 19:57] xenon…
[7]Part 1581 fact
customctx:discord/blah/watt-activation/part-158
[8]watt-activation-1583 facts
customctx:discord/blah/watt-activation/158
- full textwatt-activation-158
  text/plain2 KBdoc:agent/watt-activation-158/746cbfb1-750c-4df5-ae90-78f0235bc1e9
  Show excerpt
  [2026-03-09 16:27] xenonfun: ⏺ For batch prefill, each attention class's forward() currently runs _gated_cumsum over the full sequence and returns output — but throws away the final recurrent state. The step() method maintains that state …
[9]Part 1112 facts
customctx:discord/blah/watt-activation/part-111
[10]watt-activation-1035 facts
customctx:discord/blah/watt-activation/103
- full textwatt-activation-103
  text/plain3 KBdoc:agent/watt-activation-103/6d322edd-8b82-4859-be6f-bc7033a53fe1
  Show excerpt
  [2026-03-08 18:36] xenonfun: It appears your agents have actually already done all this work <@1211062099137265723> in your repo already. https://github.com/MonumentalSystems/harmonic-gpt/blob/master/docs/M3_DEPLOY_NOTES.md (files: Screens…

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

Resonance Attention

Rdf:typein disputerdf:type

Rdfs:labelin disputerdfs:label

Has Methodin disputehasMethod

Has Messy State HandlinghasMessyStateHandling

Does Not Accept ParameterdoesNotAcceptParameter

Located at LineslocatedAtLines

Has Limitation for O1 Generation QualityhasLimitationForO1GenerationQuality

Has Compilation IssuehasCompilationIssue

Has Python Loop OverhasPythonLoopOver

Uses Ema AccumulationusesEMAAccumulation

Uses Kuramoto Phase SyncusesKuramotoPhaseSync

Had Bugs From ReferencehadBugsFromReference

Inbound mentions (8)

assumesAudienceKnowledgeOfCodebaseAssumes Audience Knowledge of Codebase(1)

confirmCorrectnessConfirm Correctness(1)

describesMakeAttentionPassingGateInitDescribes Make Attention Passing Gate Init(1)

hasAttentionTypeHas Attention Type(1)

implementsAttentionTypeImplements Attention Type(1)

includeResonanceAttentionInclude Resonance Attention(1)

includesResonanceAttentionIncludes Resonance Attention(1)

usesAttentionMechanismUses Attention Mechanism(1)

Other facts (19)

Timeline

References (10)

See also

Keep researching

Rdf:typein dispute`rdf:type`

Rdfs:labelin dispute`rdfs:label`

Has Methodin dispute`hasMethod`

Has Messy State Handling`hasMessyStateHandling`

Does Not Accept Parameter`doesNotAcceptParameter`

Located at Lines`locatedAtLines`

Has Limitation for O1 Generation Quality`hasLimitationForO1GenerationQuality`

Has Compilation Issue`hasCompilationIssue`

Has Python Loop Over`hasPythonLoopOver`

Uses Ema Accumulation`usesEMAAccumulation`

Uses Kuramoto Phase Sync`usesKuramotoPhaseSync`

Had Bugs From Reference`hadBugsFromReference`

`assumesAudienceKnowledgeOfCodebase`Assumes Audience Knowledge of Codebase(1)

`confirmCorrectness`Confirm Correctness(1)

`describesMakeAttentionPassingGateInit`Describes Make Attention Passing Gate Init(1)

`hasAttentionType`Has Attention Type(1)

`implementsAttentionType`Implements Attention Type(1)

`includeResonanceAttention`Include Resonance Attention(1)

`includesResonanceAttention`Includes Resonance Attention(1)

`usesAttentionMechanism`Uses Attention Mechanism(1)