swiglu

as donto believed on

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

swiglu has 15 facts recorded in Dontopedia across 3 references, with 2 live disagreements.

15 facts·9 predicates·3 sources·2 in dispute

Mostly:involves operations(5), rdf:type(1), learnable param count(1)

Inbound mentions (1)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

`activationCompetitor`Activation Competitor(1)

Super Chat 20260225143238 Sa7hex:super-chat-20260225143238-sa7h

Other facts (13)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

13 facts

Predicate	Value	Ref
Involves Operations	Matmul Gate	[3]
Involves Operations	Silu	[3]
Involves Operations	Matmul Up	[3]
Involves Operations	Mul	[3]
Involves Operations	Matmul Proj	[3]
Rdf:type	Activation Function	[1]
Learnable Param Count	0	[1]
Note	Gated architecture	[1]
Predicted Likelihood	Most Likely Winner	[2]
Advantage Type	Structural Advantage	[2]
Advantage Context	Low Step Counts	[2]
Has Op Count	5	[3]
Has Parametric Difference	50% more params	[3]

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

15 undated

—

typeblah/training-and-evals/23

ex:ActivationFunction

—

labelblah/training-and-evals/23

swiglu

—

learnableParamCountblah/training-and-evals/23

—

noteblah/training-and-evals/23

Gated architecture

—

predictedLikelihoodblah/training-and-evals/24

ex:most-likely-winner

—

advantageTypeblah/training-and-evals/24

ex:structural-advantage

—

advantageContextblah/training-and-evals/24

ex:low-step-counts

—

labelblah/training-and-evals/28

swiglu activation

—