gelu
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
gelu has 13 facts recorded in Dontopedia across 2 references, with 1 live disagreement.
Mostly:uses constant(2), applies unary op(1), approximates gelu(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (2)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
containsCodeContains Code(1)
- Message 2026 02 25 13 15
ex:message-2026-02-25-13-15
hasMemberHas Member(1)
- Activation Pool
ex:activation-pool
Other facts (12)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Uses Constant | SQRT_2_OVER_PI = Math.sqrt(2 / Math.PI) | [1] |
| Uses Constant | SQRT_2_OVER_PI | [2] |
| Applies Unary Op | 0.5 * x * (1 + Math.tanh(SQRT_2_OVER_PI * (x + 0.044715 * x * x * x))) | [1] |
| Approximates Gelu | null | [1] |
| Takes Input Type | TensorData | [1] |
| Returns Type | TensorData | [1] |
| Is Defined in | Message 2026 02 25 13 15 | [1] |
| Has Parameter | Parameter a | [2] |
| Invokes Function | unaryOp | [2] |
| Defines Operation | 0.5 * x * (1 + Math.tanh(SQRT_2_OVER_PI * (x + 0.044715 * x * x * x))) | [2] |
| Uses Math Function | Math.tanh | [2] |
| Uses Coefficient | 0.044715 | [2] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (2)
ctx:discord/blah/training-and-evals/part-21ctx:discord/blah/training-and-evals/21- full texttraining-and-evals-21text/plain2 KB
doc:agent/training-and-evals-21/9cfc0243-2772-4a86-8d1d-cdb625ab29f4Show excerpt
[2026-02-25 11:49] ajaxdavis: https://alpha.omegaai.dev/runs/historic_chat_v2_20260225114638_5ke3 [2026-02-25 12:12] ajaxdavis: https://docs.google.com/document/d/1DTgZf5HC4xD1xntzZUIPAM5B4BrX9YW-sP34ekMpuHE/edit?tab=t.0' [2026-02-25 12:37]…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.