Dontopedia

25M training run

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

25M training run has 24 facts recorded in Dontopedia across 2 references, with 3 live disagreements.

24 facts·16 predicates·2 sources·3 in dispute

Mostly:has checkpoint at step(5), has batch size(2), has estimated duration(2)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (3)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

announcesProgressAnnounces Progress(1)

framesTrainingAsOngoingFrames Training As Ongoing(1)

partOfPart of(1)

Other facts (23)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

23 facts
PredicateValueRef
Has Checkpoint at Step2000[2]
Has Checkpoint at Step4000[2]
Has Checkpoint at Step6000[2]
Has Checkpoint at Step8000[2]
Has Checkpoint at Step10000[2]
Has Batch Size16[1]
Has Batch Size16[2]
Has Estimated Duration95 minutes[1]
Has Estimated Duration~95 minutes[2]
Is From Scratch25m Model[1]
Is From Scratchtrue[2]
Estimated to Complete in95 minutes[1]
Has Expected Tok Per Sec7000[1]
Has Seq Len256[1]
Has Steps10000[1]
Kicked Off AfterTraining Run 50m[1]
Processes Total Tokens40000000[1]
Saves Checkpoints atsteps 2K, 4K, 6K, 8K, 10K[1]
Has Model Size25M[2]
Has Step Count10000[2]
Has Sequence Length256[2]
Has Total Token Count40000000[2]
Has Estimated Speed7000[2]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

estimatedToCompleteInblah/watt-activation/part-644
95 minutes
hasBatchSizeblah/watt-activation/part-644
16
hasEstimatedDurationblah/watt-activation/part-644
95 minutes
hasExpectedTokPerSecblah/watt-activation/part-644
7000
hasSeqLenblah/watt-activation/part-644
256
hasStepsblah/watt-activation/part-644
10000
isFromScratchblah/watt-activation/part-644
ex:25m-model
kickedOffAfterblah/watt-activation/part-644
ex:training-run-50m
processesTotalTokensblah/watt-activation/part-644
40000000
savesCheckpointsAtblah/watt-activation/part-644
steps 2K, 4K, 6K, 8K, 10K
labelblah/watt-activation/641
25M training run
hasModelSizeblah/watt-activation/641
25M
isFromScratchblah/watt-activation/641
true
hasStepCountblah/watt-activation/641
10000
hasBatchSizeblah/watt-activation/641
16
hasSequenceLengthblah/watt-activation/641
256
hasTotalTokenCountblah/watt-activation/641
40000000
hasEstimatedSpeedblah/watt-activation/641
7000
hasEstimatedDurationblah/watt-activation/641
~95 minutes
hasCheckpointAtStepblah/watt-activation/641
2000
hasCheckpointAtStepblah/watt-activation/641
4000
hasCheckpointAtStepblah/watt-activation/641
6000
hasCheckpointAtStepblah/watt-activation/641
8000
hasCheckpointAtStepblah/watt-activation/641
10000

References (2)

2 references
  1. [1]Part 64410 facts
    ctx:discord/blah/watt-activation/part-644
  2. [2]64114 facts
    ctx:discord/blah/watt-activation/641
    • full textwatt-activation-641
      text/plain2 KBdoc:agent/watt-activation-641/f90a56d8-d0f5-46e7-92ee-3c668e2366e4
      Show excerpt
      [2026-04-16 01:42] xenonfun: ```bash ➜ ~/MS/HarmonicRust git:(master) ✗ ./target/release/wave_native_train --size 50m --data /tmp/domain_tinystories.bin --mode full --seq-len 256 --batch-size 32 --total-steps 10 --lr 0.001 --warmup 0 --log

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.