Dontopedia

Activation Pool

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Activation Pool has 26 facts recorded in Dontopedia across 4 references, with 4 live disagreements.

26 facts·7 predicates·4 sources·4 in dispute

Mostly:includes activation(6), has member(6), includes entry(5)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (2)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

composesFromComposes From(1)

supportsActivationsSupports Activations(1)

Other facts (26)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

26 facts
PredicateValueRef
Includes ActivationRelu[2]
Includes ActivationGelu[2]
Includes ActivationKan Spline[2]
Includes ActivationSilu[2]
Includes ActivationUniversal[2]
Includes ActivationSwiglu[2]
Has MemberGelu Function[4]
Has MemberSilu Function[4]
Has MemberRelu Function[4]
Has MemberSwiglu Function[4]
Has MemberUniversal Approximator[4]
Has MemberKan Spline[4]
Includes EntryGelu Entry[1]
Includes EntrySqrelu Entry[1]
Includes EntrySilu Plus Residual Entry[1]
Includes EntryGated Tanh Entry[1]
Includes EntrySilu Entry[1]
Contains MemberSilu Pool Entry[3]
Contains MemberGelu Pool Entry[3]
Contains MemberSqrelu Pool Entry[3]
Contains MemberGated Tanh Pool Entry[3]
Contains MemberSilu Residual Pool Entry[3]
Has Size6[2]
Has Size6[4]
Updated on2026-02-25[2]
Expanded From Previousnull[2]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

26 undated
—
includesEntryblah/training-and-evals/part-20
ex:gelu-entry
—
includesEntryblah/training-and-evals/part-20
ex:sqrelu-entry
—
includesEntryblah/training-and-evals/part-20
ex:silu-plus-residual-entry
—
includesEntryblah/training-and-evals/part-20
ex:gated-tanh-entry
—
includesEntryblah/training-and-evals/part-20
ex:silu-entry
—
includesActivationblah/training-and-evals/part-21
ex:relu
—
updatedOnblah/training-and-evals/part-21
2026-02-25
—
expandedFromPreviousblah/training-and-evals/part-21
null
—
includesActivationblah/training-and-evals/part-21
ex:gelu
—
includesActivationblah/training-and-evals/part-21
ex:kan-spline
—
includesActivationblah/training-and-evals/part-21
ex:silu
—
includesActivationblah/training-and-evals/part-21
ex:universal
—
hasSizeblah/training-and-evals/part-21
6
—
includesActivationblah/training-and-evals/part-21
ex:swiglu
—
containsMemberblah/training-and-evals/20
ex:silu-pool-entry
—
containsMemberblah/training-and-evals/20
ex:gelu-pool-entry
—
containsMemberblah/training-and-evals/20
ex:sqrelu-pool-entry
—
containsMemberblah/training-and-evals/20
ex:gated-tanh-pool-entry
—
containsMemberblah/training-and-evals/20
ex:silu-residual-pool-entry
—
hasSizeblah/training-and-evals/21
6
—
hasMemberblah/training-and-evals/21
ex:gelu-function
—
hasMemberblah/training-and-evals/21
ex:silu-function
—
hasMemberblah/training-and-evals/21
ex:relu-function
—
hasMemberblah/training-and-evals/21
ex:swiglu-function
—
hasMemberblah/training-and-evals/21
ex:universal-approximator
—
hasMemberblah/training-and-evals/21
ex:kan-spline

References (4)

4 references
  1. [1]Part 205 facts
    ctx:discord/blah/training-and-evals/part-20
  2. [2]Part 219 facts
    ctx:discord/blah/training-and-evals/part-21
  3. [3]205 facts
    ctx:discord/blah/training-and-evals/20
    • full texttraining-and-evals-20
      text/plain3 KBdoc:agent/training-and-evals-20/df884008-3d53-4aea-97bd-68748c59313f
      Show excerpt
      [2026-02-25 10:19] ajaxdavis: ``` There are a few concrete approaches, from least to most ambitious: 1. Parameterized activations (easy, high value) Instead of choosing between gelu and silu, parameterize a family that contains both a…
  4. [4]217 facts
    ctx:discord/blah/training-and-evals/21
    • full texttraining-and-evals-21
      text/plain2 KBdoc:agent/training-and-evals-21/9cfc0243-2772-4a86-8d1d-cdb625ab29f4
      Show excerpt
      [2026-02-25 11:49] ajaxdavis: https://alpha.omegaai.dev/runs/historic_chat_v2_20260225114638_5ke3 [2026-02-25 12:12] ajaxdavis: https://docs.google.com/document/d/1DTgZf5HC4xD1xntzZUIPAM5B4BrX9YW-sP34ekMpuHE/edit?tab=t.0' [2026-02-25 12:37]…

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

↑