Gpt 2 Small Softmax
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Gpt 2 Small Softmax has 2 facts recorded in Dontopedia across 1 reference.
2 facts·2 predicates·1 sources
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
Gpt 2 Small Softmax has 2 facts recorded in Dontopedia across 1 reference.
doc:agent/watt-activation-92/a597b55a-3d12-478b-951d-f09c655a8870[2026-03-08 01:46] xenonfun: ``` Direct comparison is tricky but here are the reference points: GPT-2 Small (124M) published benchmarks: - WikiText-103 test: 29.4 PPL - Penn Treebank: 65.9 PPL - Trained on ~8-9B tokens of WebText …
Dontopedia is in a read-only public launch. Follow the references and disputed branches now; contributions will open after durable identity and moderation are in place.