Dontopedia
Explore

Attention Type Comparison 200 Steps

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-05-02.)

Attention Type Comparison 200 Steps has 5 facts recorded in Dontopedia across 1 reference.

5 facts·5 predicates·1 sources

Mostly:has model dim(1), has num heads(1), has num layers(1)

Maturity scale raw canonical shape-checked rule-derived certified

Has Model DimhasModelDim

  • 768[1]all time · Part 317

Has Num HeadshasNumHeads

  • 12[1]all time · Part 317

Has Num LayershasNumLayers

  • 12[1]all time · Part 317

Has Num StepshasNumSteps

  • 200[1]all time · Part 317

Is CompiledisCompiled

  • true[1]all time · Part 317

Inbound mentions (1)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

describesBenchmarkDescribes Benchmark(1)

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

hasModelDimblah/watt-activation/part-317
768
hasNumHeadsblah/watt-activation/part-317
12
hasNumLayersblah/watt-activation/part-317
12
hasNumStepsblah/watt-activation/part-317
200
isCompiledblah/watt-activation/part-317
true

References (1)

1 references
  1. [1]Part 3175 facts
    customctx:discord/blah/watt-activation/part-317

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.