much larger model
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-11.)
much larger model has 9 facts recorded in Dontopedia across 7 references, with 1 live disagreement.
Mostly:rdf:type(3), has capability level(1), provides(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (7)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
requiresRequires(2)
- Coherent Generation
ex:coherent-generation - Deeper Pre Vq
ex:deeper-pre-vq
comparisonTargetComparison Target(1)
- Qwen 3.5 122b A10b
ex:qwen-3.5-122b-a10b
isTypeOfIs Type of(1)
- Roberta Large
ex:roberta-large
performsNotMuchWorseThanPerforms Not Much Worse Than(1)
- Man 122b
ex:man-122b
proposesSolutionProposes Solution(1)
- Xenonfun
ex:xenonfun
relationshipToRelationship to(1)
- Model Distillation
ex:model-distillation
Other facts (8)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Llm | [3] |
| Rdf:type | Original Model | [6] |
| Rdf:type | Model Category | [7] |
| Has Capability Level | Sonnet Capability | [1] |
| Provides | More Capacity to Learn Code to Byte Mapping | [2] |
| Supports | Factual Recall Scaling | [4] |
| Provides More Capacity | true | [5] |
| Characteristic | bigger-than-bert | [7] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (7)
ctx:discord/blah/general/part-128ctx:discord/blah/watt-activation/part-292ctx:discord/blah/general/127- full textgeneral-127text/plain3 KB
doc:agent/general-127/dd0bc789-eaf1-449d-b955-e91c7e63e815Show excerpt
[2026-04-07 12:49] ajaxdavis: someone make a full app/project benchmark where every step/layer, all models in competition exponential fan out and test all outcomes (lol bad description, here is a chatgpt generated diagram) (the point being …
ctx:discord/blah/watt-activation/178- full textwatt-activation-178text/plain3 KB
doc:agent/watt-activation-178/50ec323b-637a-4c18-bba8-73839dc1355dShow excerpt
[2026-03-10 00:29] xenonfun: ⏺ That settles it — the base instruct model has no factual knowledge at all. It generates fluent-sounding nonsense rather than facts. This is a pretraining depth problem: FineWeb-Edu teaches language patterns,…
ctx:discord/blah/watt-activation/290- full textwatt-activation-290text/plain2 KB
doc:agent/watt-activation-290/22fb306d-bdbd-4a04-aa08-e5109c0026d8Show excerpt
[2026-03-14 03:30] xenonfun: ⏺ Launched. The full pipeline (Phase 1 → encode → spherical Code LM → decoder → generate 15 samples) will take ~10 min. The Code LM now uses cos(h, w) / tau with tau=0.1 as the output head — matching the S^{d-1}…
ctx:claims/beam/52a2411f-6cdc-40f7-817f-3feef46e4a6b- full textbeam-chunktext/plain1 KB
doc:beam/52a2411f-6cdc-40f7-817f-3feef46e4a6bShow excerpt
- The model is pruned by removing 50% of the neurons in linear layers. This reduces the number of parameters and improves inference speed. 4. **Efficient Tokenizer**: - The `use_fast=True` option is used to enable the fast tokenizer …
ctx:claims/beam/63f3f6ff-b059-492e-954d-ccca67c2349d- full textbeam-chunktext/plain1020 B
doc:beam/63f3f6ff-b059-492e-954d-ccca67c2349dShow excerpt
However, I'm only achieving about 80% accuracy with this approach. I've studied LLM-based reformulation and noted a 25% intent accuracy boost for 6,000 complex queries. Can you help me improve my implementation to reach at least 92% detecti…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.