Delta memory

as donto believed on

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-07-01.)

Delta memory has 20 facts recorded in Dontopedia across 9 references, with 1 live disagreement.

20 facts·17 predicates·9 sources·1 in dispute

Mostly:rdf:type(3), advantage scales cleanly(1), has parameters(1)

Inbound mentions (15)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

`claimsImprovement`Claims Improvement(1)

Finding 1ex:finding-1

`combines`Combines(1)

Hybrid Modelex:hybrid-model

`comparesFeature`Compares Feature(1)

Finding 1ex:finding-1

`containsEntity`Contains Entity(1)

Delta Memory Rsex:delta-memory-rs

`definesEntity`Defines Entity(1)

Create Delta Memory Rsex:create-delta-memory-rs

`definesType`Defines Type(1)

Create Delta Memoryex:create-delta-memory

`demonstrateScaling`Demonstrate Scaling(1)

Training Resultsex:training-results

`evaluatesDeltaMemoryPositively`Evaluates Delta Memory Positively(1)

First Results Summary Messageex:first-results-summary-message

`exports`Exports(1)

Mod Rsex:mod-rs

`exportsSymbol`Exports Symbol(1)

Mod Rs Wiringex:mod-rs-wiring

`hasComponent`Has Component(1)

Dynamics Componentex:dynamics-component

`hasTargetComponent`Has Target Component(1)

Next Step 2ex:next-step-2

`integratesComponent`Integrates Component(1)

Mod Rs Integrationex:mod-rs-integration

`trains`Trains(1)

Load Strong Cache Into Hybrid Fixed Beta 0.3ex:load-strong-cache-into-hybrid-fixed-beta-0.3

`uses`Uses(1)

Combine Cache Baseline With Delta Correctionsex:combine-cache-baseline-with-delta-corrections

Other facts (19)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

19 facts

Predicate	Value	Ref
Rdf:type	Model Component	[7]
Rdf:type	Component	[8]
Rdf:type	Data Structure	[9]
Advantage Scales Cleanly	true	[1]
Has Parameters	4392	[1]
Contributes to	Logits in Hybrid	[2]
Works As Sole Readout	Kick Delta G8	[3]
Corrects	Hybrid Fixed Beta 0.3 Phase 2	[3]
Provides Correction Percentage	30	[3]
Pushes Bpb Below	2	[3]
Improves Lm Quality by	1	[4]
Provides Improvement Over	Cals Only	[5]
Improves Bpb by	~0.6	[5]
Improves Over	Cals Only	[5]
Helps	LM quality	[6]
Provides Improvement Amount	~1.0 BPB	[6]
Has Parameter Count	4392	[7]
Has Parameter Composition	W_q, W_k, W_v, W_o projections + gates + betas across 4 layers	[7]
Demonstrates Scaling Advantage	scaling cleanly	[7]

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

20 undated

—

advantageScalesCleanlyblah/watt-activation/part-607

true

—

hasParametersblah/watt-activation/part-607

4392

—

contributesToblah/watt-activation/part-610

ex:logits-in-hybrid

—

worksAsSoleReadoutblah/watt-activation/part-611

ex:kick-delta-g8

—

correctsblah/watt-activation/part-611

ex:hybrid-fixed-beta-0.3-phase-2

—

providesCorrectionPercentageblah/watt-activation/part-611

—

pushesBpbBelowblah/watt-activation/part-611

—

improvesLmQualityByblah/watt-activation/part-606

—

providesImprovementOverblah/watt-activation/part-605

ex:cals-only

—

improvesBpbByblah/watt-activation/part-605

~0.6

—

improvesOverblah/watt-activation/part-605

ex:cals-only

—

helpsblah/watt-activation/603

LM quality

—

providesImprovementAmountblah/watt-activation/603

~1.0 BPB

—

typeblah/watt-activation/604

ex:ModelComponent

—

labelblah/watt-activation/604

Delta memory

—

hasParameterCountblah/watt-activation/604

4392

—

hasParameterCompositionblah/watt-activation/604

W_q, W_k, W_v, W_o projections + gates + betas across 4 layers

—

demonstratesScalingAdvantageblah/watt-activation/604

scaling cleanly

—

typeblah/watt-activation/608

ex:Component

—

typedocument/0045863d-4c76-44af-bed6-b5a47132dfc1

ex:DataStructure

References (9)

9 references

[1]Part 6072 facts
ctx:discord/blah/watt-activation/part-607
[2]Part 6101 fact
ctx:discord/blah/watt-activation/part-610
[3]Part 6114 facts
ctx:discord/blah/watt-activation/part-611
[4]Part 6061 fact
ctx:discord/blah/watt-activation/part-606
[5]Part 6053 facts
ctx:discord/blah/watt-activation/part-605
[6]6032 facts
ctx:discord/blah/watt-activation/603
- full textwatt-activation-603
  text/plain3 KBdoc:agent/watt-activation-603/7aa9fa83-a058-43b0-b700-073a69d3e610
  Show excerpt
  [2026-04-10 04:25] xenonfun: ``` ⏺ Now we have real eval results on the trained models. Key observations: Results Summary (10K steps, 50% curriculum, trained model eval) ┌─────────────────┬────────────┬───────────────┬────────────────…
[7]6045 facts
ctx:discord/blah/watt-activation/604
- full textwatt-activation-604
  text/plain2 KBdoc:agent/watt-activation-604/5619f2b9-2e60-495c-a6e6-9fe7ca80a696
  Show excerpt
  [2026-04-10 04:27] xenonfun: ``` From the training output logs, the models we've been testing have 28,525 total parameters: - Constellation (decoder): 23,808 params (256 × 93 readout dim) - Readout: 153 params (mode amplitudes, pro…
[8]6081 fact
ctx:discord/blah/watt-activation/608
- full textwatt-activation-608
  text/plain2 KBdoc:agent/watt-activation-608/a9cc9bc2-b034-450f-bf85-dcb33eeaecc4
  Show excerpt
  [2026-04-10 19:18] xenonfun: at 85% test coverage on library, few more improvement and enable the swarm downloading, server becomes just a seeding node mostly. ✶ Improving handler test coverage… ⎿ ◼ Improve handler.rs coverage (49% → 70%…
[9]0045863d 4c76 44af Bed6 B5a47132dfc11 fact
ctx:claims/document/0045863d-4c76-44af-bed6-b5a47132dfc1
- full textxenonfun: ✳ Extracting tangent_project to primitives… (9m 38s · ↑ 26.5k tokens · thinking)
  text/plain826 Bdiscord:msg/dcf0bd22-6039-42fe-977d-79e9343b84b1
  Show excerpt
  ✳ Extracting tangent_project to primitives… (9m 38s · ↑ 26.5k tokens · thinking) ⎿ ◼ Extract tangent_project to primitives.rs ◻ Create coupling/delta_memory.rs with DeltaMemory ◻ Create blocks/lohe_delta.rs with LoheDeltaBlock …

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

Delta memory

Inbound mentions (15)

claimsImprovementClaims Improvement(1)

combinesCombines(1)

comparesFeatureCompares Feature(1)

containsEntityContains Entity(1)

definesEntityDefines Entity(1)

definesTypeDefines Type(1)

demonstrateScalingDemonstrate Scaling(1)

evaluatesDeltaMemoryPositivelyEvaluates Delta Memory Positively(1)

exportsExports(1)

exportsSymbolExports Symbol(1)

hasComponentHas Component(1)

hasTargetComponentHas Target Component(1)

integratesComponentIntegrates Component(1)

trainsTrains(1)

usesUses(1)

Other facts (19)

Timeline

References (9)

See also

Keep researching

`claimsImprovement`Claims Improvement(1)

`combines`Combines(1)

`comparesFeature`Compares Feature(1)

`containsEntity`Contains Entity(1)

`definesEntity`Defines Entity(1)

`definesType`Defines Type(1)

`demonstrateScaling`Demonstrate Scaling(1)

`evaluatesDeltaMemoryPositively`Evaluates Delta Memory Positively(1)

`exports`Exports(1)

`exportsSymbol`Exports Symbol(1)

`hasComponent`Has Component(1)

`hasTargetComponent`Has Target Component(1)

`integratesComponent`Integrates Component(1)

`trains`Trains(1)

`uses`Uses(1)