PG-19
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
PG-19 is standard eval dataset for byte-level LMs.
Mostly:consists of project gutenberg books pre1919(1), features clean english prose(1), has no markup noise(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (3)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
partOfPart of(3)
- Pg 19 Test
ex:pg-19-test - Pg 19 Train
ex:pg-19-train - Pg 19 Validation
ex:pg-19-validation
Other facts (18)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Consists of Project Gutenberg Books Pre1919 | True | [1] |
| Features Clean English Prose | True | [1] |
| Has No Markup Noise | True | [1] |
| Has Total Size | ~11 GB | [1] |
| Is All Ascii | True | [1] |
| Is Seventeen Times Bigger Than | Fineweb Edu Byte File | [1] |
| Is Standard Eval Dataset for | Byte Level Lms | [1] |
| Preferred Over Fineweb Edu for Scale | True | [1] |
| Presupposes Clean Data Suitability for Lms | True | [1] |
| Rdf:type | Dataset | [2] |
| Description | standard eval dataset for byte-level LMs | [2] |
| Source | Project Gutenberg | [2] |
| Time Period | pre-1919 | [2] |
| Content Type | clean English prose | [2] |
| Has Markup Noise | false | [2] |
| Encoding | ASCII | [2] |
| Total Size | ~11 GB | [2] |
| Size Comparison | 17× bigger than our FineWeb-Edu byte file | [2] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (2)
ctx:discord/blah/watt-activation/part-447ctx:discord/blah/watt-activation/445- full textwatt-activation-445text/plain3 KB
doc:agent/watt-activation-445/9fd17e7c-a213-4d83-a408-8377df103970Show excerpt
[2026-03-20 19:10] xenonfun: ``` ⏺ Already at 2.20 BPB at step 458 with bs=256. The reference numbers from CLAUDE.md: ┌──────────────────────────────┬───────┬───────┬─────────────────────────────────────┐ │ Config …
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.