AR decoder
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
AR decoder has 41 facts recorded in Dontopedia across 7 references, with 3 live disagreements.
Mostly:produces(14), conditions byte on(2), must be rewritten using(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedProducesin disputeproduces
- Word This[2]all time · Part 300
- Word Earch[2]all time · Part 300
- Word for[2]all time · Part 300
- Word Fragments[2]all time · Part 300
- Word Imported[2]all time · Part 300
- Word One[2]all time · Part 300
- Word Project[2]all time · Part 300
- Word Protec Tion[2]all time · Part 300
- Word State[2]all time · Part 300
- Word the[2]all time · Part 300
Inbound mentions (5)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
causedByCaused by(1)
- Breaking Manifold Assumption
ex:breaking-manifold-assumption
describesAsMassiveImprovementDescribes As Massive Improvement(1)
- Xenonfun
ex:xenonfun
introducedByIntroduced by(1)
- Inconsistent Optimization Geometry
ex:inconsistent-optimization-geometry
partOfPart of(1)
- Standard Transformer Block
ex:standard-transformer-block
shouldNotAppearShould Not Appear(1)
- Softmax Attention
ex:softmax-attention
Other facts (26)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Conditions Byte on | Code | [2] |
| Conditions Byte on | Previous Bytes | [2] |
| Must Be Rewritten Using | Lohe Spherical Attention Blocks | [4] |
| Must Be Rewritten Using | Lohesphericalattention Blocks | [7] |
| Enables Reconstruction | null | [1] |
| Superior to | Baseline Single Step Decoder | [1] |
| Has Bpb | 3.08 | [1] |
| Improves Bpb by | 1.87 | [1] |
| Compared to | Baseline Single Step Decoder | [1] |
| Reconstructs More Info Percent | 38 | [1] |
| Achieves Lower Bpb | Baseline Single Step Decoder | [1] |
| Conditioned on Code | null | [2] |
| Does Not Produce | Complete Sentences | [2] |
| Enables Word Fragments | null | [2] |
| Improves Over | Single Step Decoder | [2] |
| Produces Lots of | Whitespace | [2] |
| Produces Recognizable | English Word Fragments | [2] |
| Is Autoregressive | {} | [3] |
| Is Only Component | Breaking Manifold Assumption | [4] |
| Requires Rewrite | Lohe Spherical Attention | [4] |
| Introduces Inconsistency | Inconsistent Optimization Geometry | [4] |
| Deontically Must Use | Lohe Blocks | [4] |
| Rdf:type | Model Component | [5] |
| Produces Output | English Word Fragments | [6] |
| Prediction Mode | Conditional Byte Prediction | [6] |
| Realizes | Lexical Content | [6] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (7)
ctx:discord/blah/watt-activation/part-299ctx:discord/blah/watt-activation/part-300ctx:discord/blah/watt-activation/part-301ctx:discord/blah/watt-activation/part-302ctx:discord/blah/watt-activation/297- full textwatt-activation-297text/plain2 KB
doc:agent/watt-activation-297/ad91f718-f038-464f-a6d2-ba91d77fe4e3Show excerpt
[2026-03-14 05:23] xenonfun: 600K context, the UI crazy scroll thing and memory leaks are annoyin claude is sucking up 6GB now. [2026-03-14 05:24] xenonfun: ``` ⏺ Launched in rjs:longgen. This trains with longer context (512) and more steps…
ctx:discord/blah/watt-activation/298- full textwatt-activation-298text/plain2 KB
doc:agent/watt-activation-298/f5cde311-fd9a-43e7-a746-9177b5a91feeShow excerpt
[2026-03-14 05:53] xenonfun: ``` What Changed The AR decoder produces recognizable English word fragments: "the", "and", "for", "with", "this", "one", "protec(tion)", "earch", "context", "project", "state", "imported". These are real m…
ctx:discord/blah/watt-activation/300- full textwatt-activation-300text/plain3 KB
doc:agent/watt-activation-300/3b6edccf-3524-4608-838f-25890efaea15Show excerpt
[2026-03-14 06:34] xenonfun: ``` 3. Manual attention (lines 110-128) — Hand-rolled softmax attention instead of using mx.fast.scaled_dot_product_attention. MLX's fused attention kernel is significantly faster for small sequence lengths. …
See also
- Baseline Single Step Decoder
- Word This
- Code
- Previous Bytes
- Complete Sentences
- Single Step Decoder
- Word Earch
- Word for
- Word Fragments
- Word Imported
- Word One
- Word Project
- Word Protec Tion
- Word State
- Word the
- Word With
- Whitespace
- English Word Fragments
- Hex Like Artifacts
- Word and
- Word Context
- Breaking Manifold Assumption
- Lohe Spherical Attention Blocks
- Lohe Spherical Attention
- Inconsistent Optimization Geometry
- Lohe Blocks
- Model Component
- Conditional Byte Prediction
- Lexical Content
- Lohesphericalattention Blocks
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.