Dontopedia

HarmonicGPT

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

HarmonicGPT has 21 facts recorded in Dontopedia across 6 references, with 1 live disagreement.

21 facts·15 predicates·6 sources·1 in dispute

Mostly:rdf:type(3), has dimension(1), has attention type(1)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (7)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

applicableToApplicable to(1)

appliesToApplies to(1)

describesTrainingOfDescribes Training of(1)

hasFundamentallyDifferentBlockStructureThanHas Fundamentally Different Block Structure Than(1)

manifestsInManifests in(1)

partOfPart of(1)

trainsModelTrains Model(1)

Other facts (17)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

17 facts
PredicateValueRef
Rdf:typeModel[3]
Rdf:typeSoftware[4]
Rdf:typeModel Architecture[6]
Has Dimension768[1]
Has Attention TypeGrouped1[1]
Has Sequence Length2048[1]
Has Total Parameters86825760[1]
Has Heads12[1]
Has Layers12[1]
Uses Phase0Phase 0[2]
Attention Typelinear[3]
Model Dimension768[3]
Number of Layers12[3]
Number of Heads12[3]
Sequence Length2048[3]
Parameter Count86825760[3]
Has Default Config ValueMax Seq Len 512[4]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

hasDimensionblah/watt-activation/part-115
768
hasAttentionTypeblah/watt-activation/part-115
ex:grouped1
hasSequenceLengthblah/watt-activation/part-115
2048
hasTotalParametersblah/watt-activation/part-115
86825760
hasHeadsblah/watt-activation/part-115
12
hasLayersblah/watt-activation/part-115
12
usesPhase0blah/watt-activation/part-174
ex:phase-0
labelblah/watt-activation/114
HarmonicGPT
typeblah/watt-activation/114
ex:Model
attentionTypeblah/watt-activation/114
linear
modelDimensionblah/watt-activation/114
768
numberOfLayersblah/watt-activation/114
12
numberOfHeadsblah/watt-activation/114
12
sequenceLengthblah/watt-activation/114
2048
parameterCountblah/watt-activation/114
86825760
typeblah/watt-activation/119
ex:Software
labelblah/watt-activation/119
HarmonicGPT
hasDefaultConfigValueblah/watt-activation/119
ex:max-seq-len-512
labelblah/watt-activation/222
HarmonicGPT
typeblah/watt-activation/383
ex:ModelArchitecture
labelblah/watt-activation/383
HarmonicGPT

References (6)

6 references
  1. [1]Part 1156 facts
    ctx:discord/blah/watt-activation/part-115
  2. [2]Part 1741 fact
    ctx:discord/blah/watt-activation/part-174
  3. [3]1148 facts
    ctx:discord/blah/watt-activation/114
    • full textwatt-activation-114
      text/plain2 KBdoc:agent/watt-activation-114/bc8b5ab5-bbc4-4aea-ac89-9211a96127c3
      Show excerpt
      [2026-03-08 22:42] xenonfun: Now add val evaluation in the training loop, after the checkpoint save block [2026-03-08 22:44] xenonfun: ``` === linear (seq=2048) === Training HarmonicGPT | attn=linear d=768 L=12 H=12 seq=2048 Parameters: 86,
  4. [4]1193 facts
    ctx:discord/blah/watt-activation/119
    • full textwatt-activation-119
      text/plain3 KBdoc:agent/watt-activation-119/dd015076-4b38-4017-9483-3f91bdce858d
      Show excerpt
      [2026-03-09 00:25] xenonfun: okay at least generating something probablt still some bugs. ⏺ Committed and pushed. Key things done this session: 1. docs/symbiogenesis.md saved as a core document, linked prominently from CLAUDE.md 2. Roo
  5. [5]2221 fact
    ctx:discord/blah/watt-activation/222
    • full textwatt-activation-222
      text/plain3 KBdoc:agent/watt-activation-222/d8201f0f-b5d1-4b50-9f4e-2aca2c0d4c1e
      Show excerpt
      [2026-03-11 05:02] xenonfun: ⏺ mx.compile with RotationalAdamW is a dead end — the optimizer creates new array objects on each step, so inputs=[model.state] captures stale references. The error "array without primitive" is exactly what CL
  6. [6]3832 facts
    ctx:discord/blah/watt-activation/383

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.