Dontopedia
Explore

Spectral Attn

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Spectral Attn has 9 facts recorded in Dontopedia across 4 references.

9 facts·9 predicates·4 sources

Mostly:has head dim(1), has kv inp shape(1), has l(1)

Maturity scale raw canonical shape-checked rule-derived certified

Has Head DimhasHeadDim

  • 64[1]all time · Part 202

Has Kv Inp ShapehasKvInpShape

  • (B, T, H=12, L=8, d_h=64)[1]all time · Part 202

Has LhasL

  • 8[1]all time · Part 202

Has Num HeadshasNumHeads

  • 12[1]all time · Part 202

Projects V IntoprojectsVInto

  • per-head d_h=64 slices[1]all time · Part 202

Used inusedIn

Is Attention TypeisAttentionType

Rdfs:labelrdfs:label

  • spectral attn_type[3]all time · 159

Rdf:typerdf:type

Inbound mentions (3)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

comparesAttentionMechanismsCompares Attention Mechanisms(1)

hasParameterHas Parameter(1)

usesAttentionMechanismUses Attention Mechanism(1)

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

9 undated
—
hasHeadDimblah/watt-activation/part-202
64
—
hasKvInpShapeblah/watt-activation/part-202
(B, T, H=12, L=8, d_h=64)
—
hasLblah/watt-activation/part-202
8
—
hasNumHeadsblah/watt-activation/part-202
12
—
isAttentionTypeblah/watt-activation/part-112
ex:harmonic-gpt
—
projectsVIntoblah/watt-activation/part-202
per-head d_h=64 slices
—
labelblah/watt-activation/159
spectral attn_type
—
typeblah/watt-activation/159
ex:AttentionMechanism
—
usedInblah/watt-activation/part-159
ex:model-config

References (4)

4 references
  1. [1]Part 2025 facts
    customctx:discord/blah/watt-activation/part-202
  2. [2]Part 1121 fact
    customctx:discord/blah/watt-activation/part-112
  3. [3]watt-activation-1592 facts
    customctx:discord/blah/watt-activation/159
    • full textwatt-activation-159
      text/plain3 KBdoc:agent/watt-activation-159/87faceb2-b6cb-4c28-9b39-4a7caa76ded8
      Show excerpt
      [2026-03-09 16:33] xenonfun: ``` Loading checkpoint: checkpoints/fineweb_e2/best Model: 108.3M params vocab=100277 loaded in 80ms Prompt: 'The most important thing about' temp=0.8 top_k=40 stop=<|endoftext|> (100257) [compiled] ─────…
  4. [4]Part 1591 fact
    customctx:discord/blah/watt-activation/part-159

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

↑