Dontopedia

FineWeb-Edu

From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)

FineWeb-Edu has 38 facts recorded in Dontopedia across 11 references, with 2 live disagreements.

38 facts·27 predicates·11 sources·2 in dispute

Mostly:rdf:type(5), has style characteristic(4), is clean educational text(1)

Maturity scale raw canonical shape-checked rule-derived certified

Inbound mentions (12)

Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.

absorbedStyleOfAbsorbed Style of(1)

absorbedStyleOfDatasetAbsorbed Style of Dataset(1)

comparedToCompared to(1)

hasEasierDistributionHas Easier Distribution(1)

isSimplerThanIs Simpler Than(1)

presupposesDataSizePresupposes Data Size(1)

referencesDatasetReferences Dataset(1)

runsOnRuns on(1)

trainedOnTrained on(1)

usedInBenchmarkUsed in Benchmark(1)

usesDatasetUses Dataset(1)

wasOverwrittenByWas Overwritten by(1)

Other facts (34)

The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.

34 facts
PredicateValueRef
Rdf:typeDataset[7]
Rdf:typeDataset[8]
Rdf:typeDataset[9]
Rdf:typeDataset[10]
Rdf:typeDataset[11]
Has Style Characteristicstudies[10]
Has Style Characteristicresearchers[10]
Has Style Characteristicpercentages[10]
Has Style Characteristiccitations[10]
Is Clean Educational Texttrue[1]
Preferred OverPhilosophy Corpus[1]
Has Approx Lines3200000[1]
Has Lines3M[1]
Has Size624MB[1]
Is Richer ThanPhilosophy Corpus[1]
Teaches General Educational EnglishAkan Gpt2 50k Model[2]
Presupposes Educational Contenttrue[2]
Lacks Citation Noisetrue[2]
Lacks Philosophy Specific Contenttrue[2]
Is Known Datasettrue[2]
Dataset ContextBpe8k[3]
Has Diverse Academic Texttrue[4]
Style Includes Percentagestrue[5]
Style Includes Studiestrue[5]
Style Includes Researcherstrue[5]
Style Includes Citationstrue[5]
Is Pretraining CorpusPretraining Corpus[6]
Teaches Language PatternsLanguage Patterns[6]
Focuses on Language PatternsPretraining[6]
Does Not Teach Factual RecallFactual Recall[6]
Described Asdiverse academic text[9]
Has Versione2[10]
TeachesLanguage Patterns[11]
Does Not TeachFactual Recall[11]

Timeline

Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.

38 undated
—
isCleanEducationalTextblah/watt-activation/part-89
true
—
preferredOverblah/watt-activation/part-89
ex:philosophy-corpus
—
hasApproxLinesblah/watt-activation/part-89
3200000
—
hasLinesblah/watt-activation/part-89
3M
—
hasSizeblah/watt-activation/part-89
624MB
—
isRicherThanblah/watt-activation/part-89
ex:philosophy-corpus
—
teachesGeneralEducationalEnglishblah/watt-activation/part-90
ex:akan-gpt2-50k-model
—
presupposesEducationalContentblah/watt-activation/part-90
true
—
lacksCitationNoiseblah/watt-activation/part-90
true
—
lacksPhilosophySpecificContentblah/watt-activation/part-90
true
—
isKnownDatasetblah/watt-activation/part-90
true
—
datasetContextblah/watt-activation/part-119
ex:bpe8k
—
hasDiverseAcademicTextblah/watt-activation/part-144
true
—
styleIncludesPercentagesblah/watt-activation/part-162
true
—
styleIncludesStudiesblah/watt-activation/part-162
true
—
styleIncludesResearchersblah/watt-activation/part-162
true
—
styleIncludesCitationsblah/watt-activation/part-162
true
—
isPretrainingCorpusblah/watt-activation/part-178
ex:pretraining-corpus
—
teachesLanguagePatternsblah/watt-activation/part-178
ex:language-patterns
—
focusesOnLanguagePatternsblah/watt-activation/part-178
ex:pretraining
—
doesNotTeachFactualRecallblah/watt-activation/part-178
ex:factual-recall
—
typeblah/watt-activation/92
ex:Dataset
—
labelblah/watt-activation/92
FineWeb-Edu
—
typeblah/watt-activation/96
ex:Dataset
—
typeblah/watt-activation/144
ex:Dataset
—
labelblah/watt-activation/144
FineWeb-Edu
—
describedAsblah/watt-activation/144
diverse academic text
—
typeblah/watt-activation/162
ex:Dataset
—
labelblah/watt-activation/162
FineWeb-Edu
—
hasStyleCharacteristicblah/watt-activation/162
studies
—
hasStyleCharacteristicblah/watt-activation/162
researchers
—
hasStyleCharacteristicblah/watt-activation/162
percentages
—
hasStyleCharacteristicblah/watt-activation/162
citations
—
hasVersionblah/watt-activation/162
e2
—
labelblah/watt-activation/178
FineWeb-Edu
—
typeblah/watt-activation/178
ex:Dataset
—
teachesblah/watt-activation/178
ex:language-patterns
—
doesNotTeachblah/watt-activation/178
ex:factual-recall

References (11)

11 references
  1. [1]Part 896 facts
    ctx:discord/blah/watt-activation/part-89
  2. [2]Part 905 facts
    ctx:discord/blah/watt-activation/part-90
  3. [3]Part 1191 fact
    ctx:discord/blah/watt-activation/part-119
  4. [4]Part 1441 fact
    ctx:discord/blah/watt-activation/part-144
  5. [5]Part 1624 facts
    ctx:discord/blah/watt-activation/part-162
  6. [6]Part 1784 facts
    ctx:discord/blah/watt-activation/part-178
  7. [7]922 facts
    ctx:discord/blah/watt-activation/92
    • full textwatt-activation-92
      text/plain3 KBdoc:agent/watt-activation-92/a597b55a-3d12-478b-951d-f09c655a8870
      Show excerpt
      [2026-03-08 01:46] xenonfun: ``` Direct comparison is tricky but here are the reference points: GPT-2 Small (124M) published benchmarks: - WikiText-103 test: 29.4 PPL - Penn Treebank: 65.9 PPL - Trained on ~8-9B tokens of WebText …
  8. [8]961 fact
    ctx:discord/blah/watt-activation/96
    • full textwatt-activation-96
      text/plain3 KBdoc:agent/watt-activation-96/1496da73-efd0-4eb3-9ee4-4a522042ca36
      Show excerpt
      [2026-03-08 04:10] xenonfun: ``` How It Fits the Plan The symbiogenesis library has already done the heavy lifting for Phases 1–2. Here's how each piece maps: Plan Phase symbiogenesis component Status Phase 0: WS baseline Rotation…
  9. [9]1443 facts
    ctx:discord/blah/watt-activation/144
    • full textwatt-activation-144
      text/plain3 KBdoc:agent/watt-activation-144/3be4aaf8-37ca-4d9d-bc3c-e22f23534527
      Show excerpt
      [2026-03-09 15:00] xenonfun: seems to really like it: step 100/64663 0.2% loss=5.3857 ppl= 218.3 lr=1.50e-05 668ms 12,265tok/s eta=719min step 200/64663 0.3% loss=4.7992 ppl= 121.4 lr=3.00e-05 667ms 12,277tok/s eta=…
  10. [10]1627 facts
    ctx:discord/blah/watt-activation/162
    • full textwatt-activation-162
      text/plain2 KBdoc:agent/watt-activation-162/60b4e03a-418d-44da-a803-c9585844c73e
      Show excerpt
      [2026-03-09 18:40] xenonfun: ⏺ Here's my assessment: Speed: Excellent - 265 tok/s decode on M2 Ultra (idle), 14-27ms prefill. Very fast for 108M params. The compiled O(1) recurrent decode is working well. …
  11. [11]1784 facts
    ctx:discord/blah/watt-activation/178
    • full textwatt-activation-178
      text/plain3 KBdoc:agent/watt-activation-178/50ec323b-637a-4c18-bba8-73839dc1355d
      Show excerpt
      [2026-03-10 00:29] xenonfun: ⏺ That settles it — the base instruct model has no factual knowledge at all. It generates fluent-sounding nonsense rather than facts. This is a pretraining depth problem: FineWeb-Edu teaches language patterns,…

See also

Keep researching

Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.

↑