Validation Step 2000
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Validation Step 2000 has 31 facts recorded in Dontopedia across 6 references, with 5 live disagreements.
Mostly:has loss value(2), marked as best(2), has perplexity(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedOther facts (31)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Has Loss Value | 6.0279 | [1] |
| Has Loss Value | 6.0279 | [5] |
| Marked As Best | true | [1] |
| Marked As Best | Best Model Status | [5] |
| Has Perplexity | 81.7 | [2] |
| Has Perplexity | 29.4 | [4] |
| Has Loss | 4.4035 | [2] |
| Has Loss | 3.3802 | [4] |
| Loss Value | 6.8639 | [3] |
| Loss Value | 4.4035 | [6] |
| Perplexity | 957.1 | [3] |
| Perplexity | 81.7 | [6] |
| Rdf:type | Validation Step | [5] |
| Rdf:type | Validation Step | [6] |
| Occurs at Training Step | Training Step 2000 | [1] |
| Evaluated Positively | null | [1] |
| Temporally After | Training Step 2000 | [1] |
| Has Ppl Value | 414.9 | [1] |
| Has Slightly Higher Loss Than | Training Step 2000 | [1] |
| Is Best Known | null | [1] |
| Occurs After | Step 2000 | [2] |
| Belongs to | Training Run | [2] |
| Is Best Validation | True | [2] |
| Associated With Step | Training Log Step 2000 | [3] |
| Status | Best | [3] |
| Has Validation Step Number | 2000 | [4] |
| Has Status | Best Model | [4] |
| Validates Step | Training Step 2000 | [5] |
| Has Perplexity Value | 414.9 | [5] |
| Step Index | 2000 | [6] |
| Is Best Model | true | [6] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (6)
ctx:discord/blah/watt-activation/part-150ctx:discord/blah/watt-activation/part-247ctx:discord/blah/watt-activation/126- full textwatt-activation-126text/plain3 KB
doc:agent/watt-activation-126/dddfc295-807c-4943-b01a-f4f0a977c17eShow excerpt
[2026-03-09 04:03] xenonfun: ### What context count we do at this scale? ⏺ From the measurements we have, memory scales roughly linearly with total tokens in the batch: - BS=4, seq=1024 → 4,096 tokens → ~40 GB - BS=8, seq=1024 → 8,192 …
ctx:discord/blah/watt-activation/145- full textwatt-activation-145text/plain3 KB
doc:agent/watt-activation-145/64378aae-25d8-4d98-9efb-8655275675ddShow excerpt
[2026-03-09 15:14] xenonfun: recommending https://huggingface.co/datasets/HuggingFaceTB/everyday-conversations-llama3.1-2k for conversations at this gpt-2 small scale [2026-03-09 15:16] xenonfun: Practical recommendation: Start with everyda…
ctx:discord/blah/watt-activation/150- full textwatt-activation-150text/plain2 KB
doc:agent/watt-activation-150/337a9b46-3368-40e6-b1b8-d27104be216dShow excerpt
[2026-03-09 15:48] xenonfun: step 2000/16684 12.0% loss=6.0245 ppl= 413.4 lr=4.88e-05 667ms 12,290tok/s eta=163min VAL step 2000 loss=6.0279 ppl=414.9 ★ best ckpt step 2000 → step_002000 step 2100/16684 12.6% loss=6.01…
ctx:discord/blah/watt-activation/246- full textwatt-activation-246text/plain3 KB
doc:agent/watt-activation-246/e98a7e00-4e3f-4e35-bccb-faff629fa820Show excerpt
[2026-03-12 07:06] xenonfun: ```[03:04:05] step 2000/12432 16.1% txt=4.411(82ppl) img=0.000 aud=2.025 r=0.375 lr=4.79e-05 150ms 69,028tok/s [T:1000 I:0 A:1000] eta=26min VAL step 2000 loss=4.4035 ppl=81.7 * best [03:04:29] …
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.