Dontopedia

Helmholtz

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Helmholtz has 66 facts recorded in Dontopedia across 11 references, with 3 live disagreements.

66 facts·58 predicates·11 sources·3 in dispute

Mostly:rdf:type(3), has tokens per second(2), has lower capacity than(2)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (31)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

hasBlockHas Block(3)

characterizesCharacterizes(2)

appliedToApplied to(1)

closesBpbGapBetweenCloses Bpb Gap Between(1)

comparesFFNTypeCompares Ffn Type(1)

comparesPerLayerCompares Per Layer(1)

concerns500StepTrainingConcerns500 Step Training(1)

consistsOfConsists of(1)

contrastsWithContrasts With(1)

exhibitsSamePatternAsExhibits Same Pattern As(1)

hasBpbValueForHas Bpb Value for(1)

hasCapacityValueForHas Capacity Value for(1)

hasConsistentlyHigherAlignDeltaThanHas Consistently Higher Align Delta Than(1)

hasDifferentEncodingStrategyFromHas Different Encoding Strategy From(1)

hasHigherThroughputThanHas Higher Throughput Than(1)

hasLowerSpectralEntropyHas Lower Spectral Entropy(1)

hasSameInformationContentAsHas Same Information Content As(1)

hasSnrValueForHas Snr Value for(1)

hasThroughputValueForHas Throughput Value for(1)

improvesOverImproves Over(1)

includesIncludes(1)

includesHigherSpectralEntropyIncludes Higher Spectral Entropy(1)

includesLowerSnrIncludes Lower Snr(1)

involvesModelInvolves Model(1)

mentionsEntityMentions Entity(1)

shareKnowledgeOfShare Knowledge of(1)

showsEqualityBetweenShows Equality Between(1)

synchronizeAtDifferentRatesInHelmholtzSynchronize at Different Rates in Helmholtz(1)

Other facts (62)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

62 facts
PredicateValueRef
Rdf:typeFfn Type[8]
Rdf:typeModel Component[9]
Rdf:typeModel[11]
Has Tokens Per Second51000[4]
Has Tokens Per Second23200[10]
Has Lower Capacity ThanV3[5]
Has Lower Capacity ThanV3[10]
Has Speed28-39K tok/s[1]
Significantly FasterBaseline[1]
Is Significantly Faster ThanBaseline[1]
Referenced in ComparisonRotor Pattern[2]
Part of Current ImplementationTrue[3]
Uses Scalar DecayTrue[3]
Has Exponential Memory FadeTrue[3]
Has Total Params Approx8.5M[4]
Is Faster ThanGelu Mlp Baseline[4]
Has Bpb At5002.547[4]
Abbreviated AsH[5]
Exhibits Smoothing Effectnull[5]
Has Weaker Snr ThanV3[5]
Matches Exactly onLanguage Modeling[5]
Has Mean Spectral Entropy1.967[6]
Has Higher Cascade IndexV3[6]
Has Higher Spectral EntropyV3[6]
Has Higher Spectral Entropy in5 of 6 layers[6]
Has Higher Spectral Entropy ThanV3[6]
Trained for500[6]
Has Lower Spectral Entropy inLayer 0[6]
Has Mean Align Delta0.318[6]
Has Mean Cascade Index0.007[6]
Has Fiber Plus Sync PipelineFiber Sync Pipeline[6]
Has More Variance in Per Group Coherencetrue[6]
Has No Dominant Layer for Coherencetrue[6]
Has R Global at Layer50.344[6]
Has Cascade Index2 To3 Times Higher ThanV3[6]
Is ArchitectureHelmholtz[6]
Experiences More Disruption From Readout After Fibertrue[6]
Exhibits Sharper Drop in R Global at Layer5 Than V3V3[6]
Distributes Energy Broadlytrue[6]
Preferred for Broad Energy Distributionimplied[6]
Desynchronizes in Final LayerLayer 5[6]
Commits to Fiber Based EncodingBroad Distribution[6]
Spreads Coherence Uniformlytrue[6]
Has Coherence atLayer 2[6]
Has Coherence0.714[6]
Has Fiber ComponentFiber[6]
Has Flatter Coherence Profiletrue[6]
Has Metricspeed[7]
Has Speed Metrictokens-per-second[7]
Uses OperationMulti Head Cumsum[7]
Bpb At5002.547[8]
Tokens Per Second51K[8]
Params Total Model~8.5M[8]
Part ofDynamics Stack[9]
Has Bpb at Step9502.257[10]
Has Snr in Db-6.4[10]
Has Capacity in Bits2.4[10]
Sweaker Than in SnrV3[10]
Has Validation Ppl4.2[10]
Has Final Bpb2.06[10]
Has Snr Advantage DisadvantageLower Snr by 1.1 Db[10]
Has Spectral EntropyHigher Spectral Entropy[10]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

hasSpeedblah/watt-activation/part-383
28-39K tok/s
significantlyFasterblah/watt-activation/part-383
ex:baseline
isSignificantlyFasterThanblah/watt-activation/part-383
ex:baseline
referencedInComparisonblah/watt-activation/part-393
ex:rotor-pattern
partOfCurrentImplementationblah/watt-activation/part-391
ex:true
usesScalarDecayblah/watt-activation/part-391
ex:true
hasExponentialMemoryFadeblah/watt-activation/part-391
ex:true
hasTotalParamsApproxblah/watt-activation/part-386
8.5M
hasTokensPerSecondblah/watt-activation/part-386
51000
isFasterThanblah/watt-activation/part-386
ex:gelu-mlp-baseline
hasBpbAt500blah/watt-activation/part-386
2.547
abbreviatedAsblah/watt-activation/part-451
ex:h
exhibitsSmoothingEffectblah/watt-activation/part-451
null
hasLowerCapacityThanblah/watt-activation/part-451
ex:v3
hasWeakerSnrThanblah/watt-activation/part-451
ex:v3
matchesExactlyOnblah/watt-activation/part-451
ex:language-modeling
hasMeanSpectralEntropyblah/watt-activation/part-452
1.967
hasHigherCascadeIndexblah/watt-activation/part-452
ex:v3
hasHigherSpectralEntropyblah/watt-activation/part-452
ex:v3
hasHigherSpectralEntropyInblah/watt-activation/part-452
5 of 6 layers
hasHigherSpectralEntropyThanblah/watt-activation/part-452
ex:v3
trainedForblah/watt-activation/part-452
500
hasLowerSpectralEntropyInblah/watt-activation/part-452
ex:layer-0
hasMeanAlignDeltablah/watt-activation/part-452
0.318
hasMeanCascadeIndexblah/watt-activation/part-452
0.007
hasFiberPlusSyncPipelineblah/watt-activation/part-452
ex:fiber-sync-pipeline
hasMoreVarianceInPerGroupCoherenceblah/watt-activation/part-452
true
hasNoDominantLayerForCoherenceblah/watt-activation/part-452
true
hasRGlobalAtLayer5blah/watt-activation/part-452
0.344
hasCascadeIndex2To3TimesHigherThanblah/watt-activation/part-452
ex:v3
isArchitectureblah/watt-activation/part-452
Helmholtz
experiencesMoreDisruptionFromReadoutAfterFiberblah/watt-activation/part-452
true
exhibitsSharperDropInRGlobalAtLayer5ThanV3blah/watt-activation/part-452
ex:v3
distributesEnergyBroadlyblah/watt-activation/part-452
true
preferredForBroadEnergyDistributionblah/watt-activation/part-452
implied
desynchronizesInFinalLayerblah/watt-activation/part-452
ex:layer-5
commitsToFiberBasedEncodingblah/watt-activation/part-452
ex:broad-distribution
spreadsCoherenceUniformlyblah/watt-activation/part-452
true
hasCoherenceAtblah/watt-activation/part-452
ex:layer-2
hasCoherenceblah/watt-activation/part-452
0.714
hasFiberComponentblah/watt-activation/part-452
ex:fiber
hasFlatterCoherenceProfileblah/watt-activation/part-452
true
labelblah/watt-activation/381
Helmholtz
hasMetricblah/watt-activation/381
speed
hasSpeedMetricblah/watt-activation/381
tokens-per-second
usesOperationblah/watt-activation/381
ex:multi-head-cumsum
typeblah/watt-activation/384
ex:FFNType
labelblah/watt-activation/384
helmholtz
bpbAt500blah/watt-activation/384
2.547
tokensPerSecondblah/watt-activation/384
51K
paramsTotalModelblah/watt-activation/384
~8.5M
typeblah/watt-activation/383
ex:ModelComponent
labelblah/watt-activation/383
Helmholtz
partOfblah/watt-activation/383
ex:dynamics-stack
labelblah/watt-activation/449
Helmholtz
hasBpbAtStep950blah/watt-activation/449
2.257
hasSnrInDbblah/watt-activation/449
-6.4
hasCapacityInBitsblah/watt-activation/449
2.4
hasTokensPerSecondblah/watt-activation/449
23200
sweakerThanInSnrblah/watt-activation/449
ex:v3
hasLowerCapacityThanblah/watt-activation/449
ex:v3
hasValidationPplblah/watt-activation/449
4.2
hasFinalBpbblah/watt-activation/449
2.06
hasSnrAdvantageDisadvantageblah/watt-activation/449
ex:lower-snr-by-1.1-db
hasSpectralEntropyblah/watt-activation/449
ex:higher-spectral-entropy
typeblah/watt-activation/453
ex:Model

References (11)

11 references
  1. [1]Part 3833 facts
    ctx:discord/blah/watt-activation/part-383
  2. [2]Part 3931 fact
    ctx:discord/blah/watt-activation/part-393
  3. [3]Part 3913 facts
    ctx:discord/blah/watt-activation/part-391
  4. [4]Part 3864 facts
    ctx:discord/blah/watt-activation/part-386
  5. [5]Part 4515 facts
    ctx:discord/blah/watt-activation/part-451
  6. [6]Part 45226 facts
    ctx:discord/blah/watt-activation/part-452
  7. [7]3814 facts
    ctx:discord/blah/watt-activation/381
    • full textwatt-activation-381
      text/plain3 KBdoc:agent/watt-activation-381/184349fd-7bc1-4a89-ae08-89b469117e85
      Show excerpt
      [2026-03-19 00:15] xenonfun: on occasion but generally session ahs been running like 16 hrs [2026-03-19 00:16] lisamegawatts: mine is always trying to weasel out of work i feel like [2026-03-19 00:45] lisamegawatts: ## Executive Summary Th
  8. [8]3845 facts
    ctx:discord/blah/watt-activation/384
    • full textwatt-activation-384
      text/plain3 KBdoc:agent/watt-activation-384/9e57a6f6-7f88-4fd5-81f0-454435de5e3e
      Show excerpt
      [2026-03-19 01:53] xenonfun: ⏺ Pure FFN comparison — clean, no contention, sequential: ``` ┌─────────────────────┬──────────┬───────┬──────────────────────┐ │ FFN Type │ BPB @500 │ tok/s │ Params (total model) │ ├──────────
  9. [9]3833 facts
    ctx:discord/blah/watt-activation/383
  10. [10]44911 facts
    ctx:discord/blah/watt-activation/449
    • full textwatt-activation-449
      text/plain2 KBdoc:agent/watt-activation-449/f6da4410-b0fa-46d2-9cb5-99d205dd2e55
      Show excerpt
      [2026-03-21 03:48] xenonfun: ⏺ You're right. At step 950: ``` ┌──────────┬───────────┬──────────┐ │ Metric │ Helmholtz │ v3 │ ├──────────┼───────────┼──────────┤ │ BPB │ 2.257 │ 2.257 │ ├──────────┼───────────┼
  11. [11]4531 fact
    ctx:discord/blah/watt-activation/453

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.