Dontopedia

Training Step 500

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

Training Step 500 has 25 facts recorded in Dontopedia across 6 references, with 1 live disagreement.

25 facts·22 predicates·6 sources·1 in dispute

Mostly:has loss(3), rdf:type(2), is out of(1)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (2)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

decreasesOverStepsDecreases Over Steps(1)

precedesPrecedes(1)

Other facts (25)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

25 facts
PredicateValueRef
Has Loss2.6037[1]
Has Loss2.5678[2]
Has Loss6.1738[3]
Rdf:typeTraining Step[5]
Rdf:typeTraining Step[6]
Is Out of2000[1]
PrecedesTraining Step 1000[2]
Has Step Number500[2]
Has Ppl480[3]
Has Progress Percent3.0%[3]
Is Step Number500[3]
Has Duration Ms666[3]
Has Eta Minutes180[3]
Has Lr0.00005[3]
Has Tokens Per Second12296[3]
Common EndpointSweeps[4]
Step Number500[5]
Reported Loss2.5678[5]
Step Index500[6]
Loss Value8.2888[6]
Perplexity3979.1[6]
Tokens Per Second8580[6]
Elapsed Time252s[6]
Attention Ratio0.6695[6]
Has Overhead Duration127ms[6]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

isOutOfblah/vidya/part-4
2000
hasLossblah/vidya/part-4
2.6037
precedesblah/vidya/part-3
ex:training-step-1000
hasStepNumberblah/vidya/part-3
500
hasLossblah/vidya/part-3
2.5678
hasPplblah/watt-activation/part-147
480
hasProgressPercentblah/watt-activation/part-147
3.0%
isStepNumberblah/watt-activation/part-147
500
hasDurationMsblah/watt-activation/part-147
666
hasEtaMinutesblah/watt-activation/part-147
180
hasLossblah/watt-activation/part-147
6.1738
hasLrblah/watt-activation/part-147
0.00005
hasTokensPerSecondblah/watt-activation/part-147
12296
commonEndpointblah/watt-activation/part-392
ex:sweeps
typeblah/vidya/3
ex:TrainingStep
stepNumberblah/vidya/3
500
reportedLossblah/vidya/3
2.5678
typeblah/watt-activation/201
ex:TrainingStep
stepIndexblah/watt-activation/201
500
lossValueblah/watt-activation/201
8.2888
perplexityblah/watt-activation/201
3979.1
tokensPerSecondblah/watt-activation/201
8580
elapsedTimeblah/watt-activation/201
252s
attentionRatioblah/watt-activation/201
0.6695
hasOverheadDurationblah/watt-activation/201
127ms

References (6)

6 references
  1. [1]Part 42 facts
    ctx:discord/blah/vidya/part-4
  2. [2]Part 33 facts
    ctx:discord/blah/vidya/part-3
  3. [3]Part 1478 facts
    ctx:discord/blah/watt-activation/part-147
  4. [4]Part 3921 fact
    ctx:discord/blah/watt-activation/part-392
  5. [5]33 facts
    ctx:discord/blah/vidya/3
    • full textvidya-3
      text/plain2 KBdoc:agent/vidya-3/36dc77aa-7dff-487d-af09-d932dc181732
      Show excerpt
      [2026-02-20 07:37] rolandnsharp7643: roland@cube:~/code/flow/ocaml$ ./microgpt_scaled num docs: 16478 vocab size: 80 num params: 206848 step 500 / 2000 | loss 2.5678 step 1000 / 2000 | loss 2.1392 step 1500 / 2000 | loss 1.7365 step 2000 /
  6. [6]2018 facts
    ctx:discord/blah/watt-activation/201
    • full textwatt-activation-201
      text/plain3 KBdoc:agent/watt-activation-201/d56596e8-50bd-4e0f-82d6-460f54290418
      Show excerpt
      [2026-03-10 06:49] xenonfun: ``` ====================================================================== CONFIG: lohe_spherical+lohe_v2 ====================================================================== Parameters: 93,766,464 step

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.