Our Model
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-05-02.)
Our Model has 26 facts recorded in Dontopedia across 3 references.
Mostly:equivalent to(1), achieved bpb drop(1), has parameters(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (4)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
has14xMoreParametersHas14x More Parameters(1)
- Gpt 2
ex:gpt-2
has15xMoreTrainingStepsHas15x More Training Steps(1)
- Gpt 2
ex:gpt-2
hasZeroCostHas Zero Cost(1)
- Model Drop Call
ex:model-drop-call
zeroComputationalCostZero Computational Cost(1)
- Dropout Zero
ex:dropout-zero
Other facts (26)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Equivalent to | Loheffn V2 | [1] |
| Achieved Bpb Drop | 2.39 to 1.572 | [2] |
| Has Parameters | 8.25M | [2] |
| Is3x Better Than | Vq Model | [2] |
| Is Still Improving | true | [2] |
| Is Within1 6x of | Gpt 2 | [2] |
| Nears Gpt2 Performance | 1.6x worse | [2] |
| Outperforms Ngram Level | Bpb 1 572 | [2] |
| Predicted to Improve Further | Future Training Runs | [2] |
| Presupposes Char Level | Good Char Level Model | [2] |
| Shares Training Budget | 20K steps | [2] |
| Crossed Territory From | Basic Statistics Territory | [2] |
| Crossed Territory to | Legitimate Neural Language Model Territory | [2] |
| Entered Legitimate Neural Lm Territory | true | [2] |
| Has Bpb Score | 1.572 | [2] |
| Has Checkpoints | Best Checkpoints | [2] |
| Has Improvement Slope | -0.052 BPB per 1K steps | [2] |
| Byte Level | true | [3] |
| Smaller Scale Advantage | true | [3] |
| Has Params | 8400000 | [3] |
| Operates on Raw Bytes | true | [3] |
| At Iterations | 6000 | [3] |
| Has Bpb | 1.99 | [3] |
| Progressing Well | true | [3] |
| Worse Than Gpt2 by Factor | 4.7 | [3] |
| Nats Per Byte | 1.38 | [3] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (3)
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.