Dontopedia
Explore

Spectral Attention Equivalent

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Spectral Attention Equivalent has 10 facts recorded in Dontopedia across 2 references.

10 facts·10 predicates·2 sources

Mostly:has element count per forward(1), has shape64(1), has shape8(1)

Maturity scale raw canonical shape-checked rule-derived certified

Has Element Count Per ForwardhasElementCountPerForward

  • 25M[2]all time · Part 203

Has Shape64hasShape64

Has Shape8hasShape8

Has Shape12hasShape12

Has Shape ThasShapeT

Has Shape BhasShapeB

Reason for Smaller SizereasonForSmallerSize

Element CountelementCount

  • 25000000[1]sourceall time · 202

Tensor DimensionstensorDimensions

  • (B, T, 12, 8, 64)[1]all time · 202

Rdf:typerdf:type

Inbound mentions (3)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

comparesWithCompares With(1)

isLargerThanIs Larger Than(1)

sizeMatchTargetSize Match Target(1)

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

elementCountblah/watt-activation/202
25000000
hasElementCountPerForwardblah/watt-activation/part-203
25M
hasShape12blah/watt-activation/202
ex:feature-dimension-12
hasShape64blah/watt-activation/202
ex:feature-dimension-64
hasShape8blah/watt-activation/202
ex:feature-dimension-8
hasShapeBblah/watt-activation/202
ex:batch-dimension
hasShapeTblah/watt-activation/202
ex:time-dimension
typeblah/watt-activation/202
ex:TensorConfiguration
reasonForSmallerSizeblah/watt-activation/202
ex:split-per-head
tensorDimensionsblah/watt-activation/202
(B, T, 12, 8, 64)

References (2)

2 references
  1. customctx:discord/blah/watt-activation/202
    • full textwatt-activation-202
      text/plain3 KBdoc:agent/watt-activation-202/bfa1acbb-7492-43ef-befc-99b62acad42a
      Show excerpt
      [2026-03-10 06:54] xenonfun: ``` lohe_spherical+lohe_v2 summary: train loss (last 50): 7.8510 ppl=2568.3 val loss (final): 7.8019 ppl=2445.1 sys_r @1000: 0.8817 global_r @1000: 0.2008 attn_r @1000:
  2. [2]Part 2031 fact
    customctx:discord/blah/watt-activation/part-203

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.