decay gates
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
decay gates has 31 facts recorded in Dontopedia across 11 references, with 1 live disagreement.
Mostly:rdf:type(2), improved performance(1), made big difference on(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (9)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
affirmsApplicabilityAffirms Applicability(1)
- Technical Response
ex:technical-response
assertsSimilarityToAsserts Similarity to(1)
- Xenonfun
ex:xenonfun
framesGatesPositivelyFrames Gates Positively(1)
- Text
ex:text
mentionsConceptMentions Concept(1)
- Log Entry 2026 03 19 04 50 Lisamegawatts
ex:log-entry-2026-03-19-04-50-lisamegawatts
mightNeedMight Need(1)
- Project
ex:project
providesInsightsProvides Insights(1)
- Lisamegawatts
ex:lisamegawatts
suggestedUsingSuggested Using(1)
- Lisamegawatts
ex:lisamegawatts
usesDecayGatesUses Decay Gates(1)
- L24 With Decay Gates
ex:l24-with-decay-gates
usesFeatureUses Feature(1)
- Combo L 24 Decay Gates
ex:combo-l-24-decay-gates
Other facts (30)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Feature | [9] |
| Rdf:type | Concept | [10] |
| Improved Performance | Clifford Gpt | [1] |
| Made Big Difference on | Clifford Gpt | [1] |
| Previously Tested | Clifford Gpt | [1] |
| Prevent Over Sync | true | [2] |
| Existentially Committed to by Text | true | [2] |
| Gave Bpb Improvement | 0.1 | [2] |
| Cause Bpb Improvement | 0.1 | [2] |
| Bound | Effective Information Horizon | [3] |
| Work by Decaying | Old Rotations | [3] |
| Positively Evaluated for Long Seq | null | [3] |
| Help With | Long Sequences | [3] |
| Prevent Numerical Issues | null | [3] |
| Teleologically Bound Info Horizon | null | [3] |
| Expected to Prevent Collapse | Prior L24 Collapse | [4] |
| Prevents Collapse in Deep Models | Deep Layer Collapse | [4] |
| Mitigates Collapse Risk | Collapse Risk | [4] |
| Were Implemented | null | [5] |
| Are Clear Win | Performance Improvement | [6] |
| Causes Healthy R | Gated Rotor | [6] |
| Keep R in Range | 0.2-0.3 | [6] |
| Prevent | Degenerate Accumulation | [6] |
| Scale Dependent | true | [7] |
| Learn Different Patterns | at different scales | [7] |
| Part of Model Architecture | null | [8] |
| Had Impact on | Clifford Gpt | [9] |
| Magnitude of Impact | big difference | [9] |
| Contextual Reference | Log Entry 2026 03 19 04 48 Xenonfun | [10] |
| Expected to Prevent | Collapse | [11] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (11)
ctx:discord/blah/watt-activation/part-390ctx:discord/blah/watt-activation/part-400ctx:discord/blah/watt-activation/part-401ctx:discord/blah/watt-activation/part-409ctx:discord/blah/watt-activation/part-410ctx:discord/blah/watt-activation/part-403ctx:discord/blah/watt-activation/part-413ctx:discord/blah/watt-activation/part-399ctx:discord/blah/watt-activation/388- full textwatt-activation-388text/plain2 KB
doc:agent/watt-activation-388/46a6b190-3823-4de5-b207-66c8e6b2684bShow excerpt
[2026-03-19 02:30] xenonfun: (files: Screenshot_2026-03-18_at_10.30.23_PM.png) [2026-03-19 02:30] lisamegawatts: ah you need to go adamw possible [2026-03-19 02:31] lisamegawatts: no rotation [2026-03-19 02:32] xenonfun: we got too synced …
ctx:discord/blah/watt-activation/397- full textwatt-activation-397text/plain3 KB
doc:agent/watt-activation-397/3fd55eae-9754-439e-8099-6ac93dab0c7dShow excerpt
[2026-03-19 04:45] lisamegawatts: Checkpoint saved: checkpoints/wire_H16_L8_s42.pt === RESULT === === GENERATION === Prompt: "The nature of consciousness is" 2026-03-19 04:43:22,583 [INFO] __main__: Output: The nature of consciousness i…
ctx:discord/blah/watt-activation/407- full textwatt-activation-407text/plain2 KB
doc:agent/watt-activation-407/1a4e2c74-8f99-44f6-a04c-f4a02b6cc171Show excerpt
[2026-03-19 06:36] xenonfun: Other knobs you could turn: ``` ┌─────────────────────┬─────────┬──────────────┬───────────────────────────────────────────────────┐ │ Knob │ Current │ Options │ E…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.