Activations
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Activations has 8 facts recorded in Dontopedia across 7 references.
Mostly:are evolvable(1), require varied lr(1), presupposed per layer(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (2)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
evolvesLikeEvolves Like(1)
- Dropout Rate
ex:dropout-rate
referencesTopicReferences Topic(1)
- Regularization Evolution
ex:regularization-evolution
Other facts (8)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Are Evolvable | Project | [1] |
| Require Varied Lr | Learning Rate Evolution | [1] |
| Presupposed Per Layer | null | [2] |
| Have Essential Learnable Params | true | [3] |
| Exist As Competitors | Alphas Symbiogenesis System | [4] |
| Essential Property | Learnable Params for Some | [5] |
| Dominate Over Model Size | null | [6] |
| Rdf:type | Component | [7] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (7)
ctx:discord/blah/training-and-evals/part-19ctx:discord/blah/training-and-evals/part-20ctx:discord/blah/training-and-evals/part-24ctx:discord/blah/training-and-evals/part-23ctx:discord/blah/training-and-evals/part-26ctx:discord/blah/watt-activation/part-401ctx:discord/blah/omega/1197- full textomega-1197text/plain2 KB
doc:agent/omega-1197/d61d934c-4f44-428a-8261-10aec4772669Show excerpt
[2026-03-05 10:10] lisamegawatts: hm i mean honestly those are really helpful suggestions, but in the case of Mega Watts, he sort of needs to have privileged information in order to be an effective liutenant. Are there any SOTA techniques f…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.