Qk Param Reduction
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Qk Param Reduction has 1 fact recorded in Dontopedia across 1 reference.
1 facts·1 predicates·1 sources
Maturity scale
raw canonical shape-checked rule-derived certifiedHas SpecificationhasSpecification
- 32x768 vs SpectralAttn's per-head projections[1]all time · 203
Inbound mentions (1)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. “X motherOf this subject” — and answer questions the forward facts can't. Grouped by predicate.
involvesInvolves(1)
- Simpler Attention Mechanism
ex:simpler-attention-mechanism
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
—
hasSpecificationblah/watt-activation/203
32x768 vs SpectralAttn's per-head projections
References (1)
1 references
- custom
ctx:discord/blah/watt-activation/203- full textwatt-activation-203text/plain2 KB
doc:agent/watt-activation-203/1245ede9-7e37-4bbe-a212-202bb86ee81dShow excerpt
[2026-03-10 07:17] xenonfun: ## Summary ``` Config Params Val PPL sys_r global_r attn_r Tok/s Wall(m) ----------------------------------------------------------------------------------------------- spec…