Dontopedia

ternary_attn

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

ternary_attn has 47 facts recorded in Dontopedia across 6 references, with 5 live disagreements.

47 facts·38 predicates·6 sources·5 in dispute

Mostly:uses encoding(3), rdf:type(3), has group count(2)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (3)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

depthScaledToDepth Scaled to(1)

hasLessDifferentiationHas Less Differentiation(1)

includesConfigIncludes Config(1)

Other facts (44)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

44 facts
PredicateValueRef
Uses EncodingBpsk 16[2]
Uses EncodingBpsk Encoding[5]
Uses EncodingQpsk 8[6]
Rdf:typeModel Configuration[3]
Rdf:typeModel Configuration[4]
Rdf:typeConfiguration[5]
Has Group Count8[5]
Has Group Count2[6]
Has Parameter Count25000[5]
Has Parameter Count6000[6]
Has H Value4[1]
Has Readout Dimension125[1]
Has Config Id4[1]
Has Config LabelL=24 G=8 H=4[1]
Has Decoder Params Count32001[1]
Has Dynamics Params Count6632[1]
Has Flops Per Token116000[1]
Represents Maximal Depthtrue[1]
Has L Value24[1]
Has G Value8[1]
Has Total Params Count38633[1]
Has Groups HeightG=8 H=2[2]
Has Approx Params25000[2]
Uses ModelHelmholtz L12[2]
Config StringL=24 G=8 H=4[4]
Param Count38633[4]
Dynamics Param Count6632[4]
Decoder Param Count32001[4]
Flops Per Token116000[4]
Readout Dimension125[4]
Part ofSweep Event 2026 03 19[4]
Has Hyperparameter L24[4]
Has Hyperparameter G8[4]
Has Hyperparameter H4[4]
Config Number4[5]
Has Head Count2[5]
Uses ArchitectureHelmholtz Model[5]
Has Layer Count12[5]
Has Head Dimension4[6]
Uses Block TypeRotor Block[6]
Has Bits Per Byte At5004.193[6]
Has Correlation Value0.429[6]
Has Tokens Per Second197000[6]
Parameter Count Is Approximatetrue[6]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

47 undated
—
hasHValueblah/watt-activation/part-388
4
—
hasReadoutDimensionblah/watt-activation/part-388
125
—
hasConfigIdblah/watt-activation/part-388
4
—
hasConfigLabelblah/watt-activation/part-388
L=24 G=8 H=4
—
hasDecoderParamsCountblah/watt-activation/part-388
32001
—
hasDynamicsParamsCountblah/watt-activation/part-388
6632
—
hasFlopsPerTokenblah/watt-activation/part-388
116000
—
representsMaximalDepthblah/watt-activation/part-388
true
—
hasLValueblah/watt-activation/part-388
24
—
hasGValueblah/watt-activation/part-388
8
—
hasTotalParamsCountblah/watt-activation/part-388
38633
—
usesEncodingblah/watt-activation/part-392
ex:bpsk-16
—
hasGroupsHeightblah/watt-activation/part-392
G=8 H=2
—
hasApproxParamsblah/watt-activation/part-392
25000
—
usesModelblah/watt-activation/part-392
ex:helmholtz-l12
—
labelblah/watt-activation/276
ternary_attn
—
typeblah/watt-activation/276
ex:ModelConfiguration
—
typeblah/watt-activation/386
ex:ModelConfiguration
—
labelblah/watt-activation/386
L=24 G=8 H=4
—
configStringblah/watt-activation/386
L=24 G=8 H=4
—
paramCountblah/watt-activation/386
38633
—
dynamicsParamCountblah/watt-activation/386
6632
—
decoderParamCountblah/watt-activation/386
32001
—
flopsPerTokenblah/watt-activation/386
116000
—
readoutDimensionblah/watt-activation/386
125
—
partOfblah/watt-activation/386
ex:sweep-event-2026-03-19
—
hasHyperparameterLblah/watt-activation/386
24
—
hasHyperparameterGblah/watt-activation/386
8
—
hasHyperparameterHblah/watt-activation/386
4
—
typeblah/watt-activation/390
ex:Configuration
—
configNumberblah/watt-activation/390
4
—
usesEncodingblah/watt-activation/390
ex:BPSK-encoding
—
hasGroupCountblah/watt-activation/390
8
—
hasHeadCountblah/watt-activation/390
2
—
usesArchitectureblah/watt-activation/390
ex:helmholtz-model
—
hasLayerCountblah/watt-activation/390
12
—
hasParameterCountblah/watt-activation/390
25000
—
labelblah/watt-activation/393
Config G=2 H=4 QPSK (8) Rotor
—
hasGroupCountblah/watt-activation/393
2
—
hasHeadDimensionblah/watt-activation/393
4
—
usesEncodingblah/watt-activation/393
ex:qpsk-8
—
usesBlockTypeblah/watt-activation/393
ex:rotor-block
—
hasBitsPerByteAt500blah/watt-activation/393
4.193
—
hasCorrelationValueblah/watt-activation/393
0.429
—
hasTokensPerSecondblah/watt-activation/393
197000
—
hasParameterCountblah/watt-activation/393
6000
—
parameterCountIsApproximateblah/watt-activation/393
true

References (6)

6 references
  1. [1]Part 38811 facts
    ctx:discord/blah/watt-activation/part-388
  2. [2]Part 3924 facts
    ctx:discord/blah/watt-activation/part-392
  3. [3]2762 facts
    ctx:discord/blah/watt-activation/276
    • full textwatt-activation-276
      text/plain3 KBdoc:agent/watt-activation-276/53331a47-df58-4d3f-a691-96a8098e7b35
      Show excerpt
      [2026-03-13 21:31] xenonfun: ⏺ Results are in: ``` ┌───────────────┬───────────────┬────────────────────────────────┬───────┐ │ │ fp32 │ Ternary 1.58-bit │ Delta │ ├───────────────┼───────────────┼…
  4. [4]38612 facts
    ctx:discord/blah/watt-activation/386
    • full textwatt-activation-386
      text/plain2 KBdoc:agent/watt-activation-386/56c807c0-0221-454e-97c5-567cf059cb84
      Show excerpt
      [2026-03-19 02:19] xenonfun: ``` ⏺ Sweep running — 7 configs sequential, no contention. ~15-20 min total. Configs: ┌─────┬───────────────┬────────┬──────────┬─────────┬───────────┬─────────────┐ │ # │ Config │ Params │ Dynamic…
  5. [5]3908 facts
    ctx:discord/blah/watt-activation/390
    • full textwatt-activation-390
      text/plain2 KBdoc:agent/watt-activation-390/0969ed20-089d-4c11-9ef9-6650032ec4ea
      Show excerpt
      [2026-03-19 03:16] xenonfun: ⏺ Rotor model: 34,001 params (24 more than Helmholtz — the delta_proj weights). Works perfectly. [2026-03-19 03:26] xenonfun: ⏺ 227K tok/s — 25x speedup from the parallel scan. Was 9K with the sequential loop. N…
  6. [6]39310 facts
    ctx:discord/blah/watt-activation/393
    • full textwatt-activation-393
      text/plain3 KBdoc:agent/watt-activation-393/d9206d9a-8fe3-4b8a-9bba-45db3179f660
      Show excerpt
      [2026-03-19 03:51] xenonfun: ⏺ Excellent results! Almost all done. Here's the encoding comparison with proper LR: ``` ┌─────────┬───────────┬───────────┬──────────┬───────┬───────┬────────┐ │ Config │ Encoding │ Block │ BPB @500 │…

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

↑