Dontopedia

tok_emb.weight

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

tok_emb.weight has 4 facts recorded in Dontopedia across 3 references.

4 facts·3 predicates·3 sources
Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (1)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

includesParameterInstanceIncludes Parameter Instance(1)

Other facts (3)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

3 facts
PredicateValueRef
Has Decay Rate0.478[1]
Placed in GroupEmb Group[1]
Is Rotational ParamModel Lohe Spherical[2]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

hasDecayRateblah/watt-activation/part-36
0.478
placedInGroupblah/watt-activation/part-36
ex:emb-group
isRotationalParamblah/watt-activation/part-264
ex:model-lohe-spherical
labelblah/watt-activation/262
tok_emb.weight

References (3)

3 references
  1. [1]Part 362 facts
    ctx:discord/blah/watt-activation/part-36
  2. [2]Part 2641 fact
    ctx:discord/blah/watt-activation/part-264
  3. [3]2621 fact
    ctx:discord/blah/watt-activation/262
    • full textwatt-activation-262
      text/plain3 KBdoc:agent/watt-activation-262/7fc84008-156e-492b-a709-12c13884e540
      Show excerpt
      [2026-03-13 04:21] xenonfun: what is and isn't rotational and effected by rotational strenght : • For this model, all 1D params are non-rotational. That means: - all LayerNorm params: - blocks.*.ln1.weight - blocks.*.ln1.

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.