AnchorKAN
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
AnchorKAN has 80 facts recorded in Dontopedia across 11 references, with 6 live disagreements.
Mostly:rdf:type(4), uses soft attractors(2), tokens seen so far(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (16)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
areActiveAre Active(1)
- Soft Attractors
ex:soft-attractors
classifiedAsUselessClassified As Useless(1)
- Soft Attractors
ex:soft-attractors
concernsSummarizingConcerns Summarizing(1)
- Important Reporting Note Message
ex:important-reporting-note-message
estimatedSpeedAdvantageEstimated Speed Advantage(1)
- Xenonfun
ex:xenonfun
exhibitsSimilarPatternToExhibits Similar Pattern to(1)
- Vq
ex:vq
fasterThanAnchorkanFaster Than Anchorkan(1)
- Spectral
ex:spectral
hasSubjectHas Subject(1)
- Message 2
ex:message-2
hasWorsePerplexityThanHas Worse Perplexity Than(1)
- Spectralattention
ex:spectralattention
includesVariantIncludes Variant(1)
- Current Architecture Context
ex:current-architecture-context
involvesEntityInvolves Entity(1)
- Comparison Method Ideal
ex:comparison-method-ideal
plannedSuccessorToPlanned Successor to(1)
- Sphericalvq
ex:sphericalvq
portsPorts(1)
- Direction Mlx Faithful
ex:direction-mlx-faithful
presentsHeadToHeadComparisonPresents Head to Head Comparison(1)
- First Message
ex:first-message
producesCoherentEnglishWordsProduces Coherent English Words(1)
- Ppl 242 Output
ex:ppl-242-output
referencesInComparisonReferences in Comparison(1)
- Spectral
ex:spectral
teleologicalForAnchorkanTeleological for Anchorkan(1)
- Kuramoto Loop
ex:kuramoto-loop
Other facts (75)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Model Architecture | [6] |
| Rdf:type | Model Architecture | [7] |
| Rdf:type | Architecture | [9] |
| Rdf:type | Mechanism | [10] |
| Uses Soft Attractors | Memory Mechanism | [1] |
| Uses Soft Attractors | Soft Attractors | [5] |
| Tokens Seen So Far | ~65M (16K × 4096) | [2] |
| Tokens Seen So Far | 65000000 | [6] |
| Learning State | learning vocabulary and basic structure | [6] |
| Learning State | not developed strong topical coherence | [6] |
| Is Evidence Against | Soft Finite Attractors | [11] |
| Is Evidence Against | Fix | [11] |
| Has S2 At20k | 1.8% | [1] |
| Marginally Worse Than Baseline | Baseline | [1] |
| Has Key Insight | Soft attractors: active but useless | [1] |
| Lacks Strong Topical Coherence Yet | At Ppl 242 | [2] |
| Ontologically Similar to | Gpt 2 Architecture | [2] |
| Matches Ppl at Equivalent Compute | Quadratic Attention | [2] |
| Seen Tokens Vs Gpt2 Completion | ~30x fewer | [2] |
| Known to Match | Quadratic Attention | [2] |
| Is Learning Vocabulary and Basic Structure | Clearly | [2] |
| Uses Attention | Anchorkan O L M | [2] |
| Has Context Length | 4096 | [2] |
| Has Data Gap Vs Gpt2 | ~30x less data | [2] |
| Ppl Measured on | Training Loss | [2] |
| Has Params | 145M | [2] |
| Trained on | Fineweb Edu | [2] |
| Tokens At2 Epochs | ~266M | [2] |
| Has Significantly Fewer Tokens Than | Gpt 2 Small | [2] |
| Uses Fineweb Edu Corpus | Standard Dataset | [2] |
| Learned Punctuation Common | true | [3] |
| Uses Mx Cumsum | plain mx.cumsum (not _gated_cumsum) | [3] |
| Uses Commas Periods Dashes Parentheses | dominate every output | [3] |
| Example Output | "the, – for well on the to" | [3] |
| Exists As Compile Compatible | true | [3] |
| Has No Blockers | true | [3] |
| Has Not Learned When to Use Punctuation | true | [3] |
| Heavily Punctuation Loaded | true | [3] |
| Holds Cum Gv Tensor | (8, 2048, 4, 8, 208) | [3] |
| Holds V Anchors Tensor | (8, 2048, 4, 8, 208) | [3] |
| Slower Due To5 D Tensors | Spectral | [3] |
| Is Fully Compile Compatible | true | [3] |
| Direction Is Closed | true | [4] |
| References Prior Experiment | true | [4] |
| S3 Rebinding Score | 42.8% | [5] |
| Dc128 Score | 93.9% | [5] |
| Worse Than Baseline on Multiple Metrics | S1 S3 S4 | [5] |
| S2 Distractor Score | 1.8% | [5] |
| S1 Direct Score | 52.1% | [5] |
| Bpb Score | 2.105 | [5] |
| S5 Scoped Score | 2.2% | [5] |
| S4 Multi Entity Score | 20.1% | [5] |
| Parameter Count | 145000000 | [6] |
| Tokens at Two Epochs | 266000000 | [6] |
| Data Volume Compared to | Gpt 2 Small | [6] |
| Has Relative Data Volume | ~30x less | [6] |
| Context Length | 4096 | [6] |
| Evaluated on | Training Loss Metric | [6] |
| Uses Attention Mechanism | Anchorkan O Lm | [6] |
| Has Relative Token Count | ~30x fewer | [6] |
| Is Bottleneck | false | [6] |
| Has Perplexity | 242 | [6] |
| Perplexity Context | Eval State 242 | [6] |
| Target Perplexity | 185 | [6] |
| Expected Quality at Ppl185 | noticeably better | [6] |
| Status As | implemented and tested | [10] |
| Close to Native Physics of | Antenna | [10] |
| Provides | Finite Attractor Mechanism | [10] |
| Described As | more natural first attempt | [10] |
| Provides Feature | Stable Finite Identity Attractors | [10] |
| Characterized As | very strong fit | [10] |
| Recommended Action | Should Now Be Fired | [10] |
| Uses Anchors | true | [11] |
| Anchors Did Not Help Persistence | true | [11] |
| Strengthens Case for | Discrete Identity Coding | [11] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (11)
ctx:discord/blah/random/part-38ctx:discord/blah/watt-activation/part-92ctx:discord/blah/watt-activation/part-232ctx:discord/blah/watt-activation/part-374ctx:discord/blah/watt-activation/part-376ctx:discord/blah/watt-activation/92- full textwatt-activation-92text/plain3 KB
doc:agent/watt-activation-92/a597b55a-3d12-478b-951d-f09c655a8870Show excerpt
[2026-03-08 01:46] xenonfun: ``` Direct comparison is tricky but here are the reference points: GPT-2 Small (124M) published benchmarks: - WikiText-103 test: 29.4 PPL - Penn Treebank: 65.9 PPL - Trained on ~8-9B tokens of WebText …
ctx:discord/blah/watt-activation/103- full textwatt-activation-103text/plain3 KB
doc:agent/watt-activation-103/6d322edd-8b82-4859-be6f-bc7033a53fe1Show excerpt
[2026-03-08 18:36] xenonfun: It appears your agents have actually already done all this work <@1211062099137265723> in your repo already. https://github.com/MonumentalSystems/harmonic-gpt/blob/master/docs/M3_DEPLOY_NOTES.md (files: Screens…
ctx:discord/blah/watt-activation/311- full textwatt-activation-311text/plain2 KB
doc:agent/watt-activation-311/f942f53b-f6c0-497d-a8cc-7bbe7ae3efb9Show excerpt
[2026-03-15 00:39] xenonfun: Key Findings Star topology is best (1,685.6 ppl) — 8% better than baseline anchor_kan (1,756-2,013 range). The hub-and-spoke structure concentrates coupling through one central anchor, similar to the DC mode …
ctx:discord/blah/watt-activation/318- full textwatt-activation-318text/plain3 KB
doc:agent/watt-activation-318/f52d95a8-f461-40d1-9360-f08558b18eb1Show excerpt
[2026-03-15 02:47] xenonfun: ⏺ I see you're working on wire encoding / phase modulation — that's a fascinating direction. Let me check what you've got: [2026-03-15 02:47] lisamegawatts: Wire QPSK + Standard: PPL 4.94, Byte Accuracy 51.5% T…
ctx:discord/blah/watt-activation/369- full textwatt-activation-369text/plain2 KB
doc:agent/watt-activation-369/0cb2b937-fe59-4554-9b34-62ddb285f694Show excerpt
[2026-03-18 16:16] xenonfun: Yes — this is very relevant, and it changes the ranking. Given: S1 plateauing again at 4.1% DC continuing to rise and the fact that you already have AnchorKAN implemented and tested I would now rank the mec…
ctx:discord/blah/watt-activation/372- full textwatt-activation-372text/plain2 KB
doc:agent/watt-activation-372/5df1e4bc-b9b4-4d7d-ad8f-c18916f7e8aeShow excerpt
[2026-03-18 17:55] xenonfun: ``` Recommended panels (3) Panel 1: Anchor Health (line chart, time series) - Y-axis left: anchor_perplexity (range 0 to anchor_count, e.g. 32). Line color: blue. - Y-axis right: anchor_dead count. Line…
See also
- Baseline
- Memory Mechanism
- At Ppl 242
- Gpt 2 Architecture
- Quadratic Attention
- Clearly
- Anchorkan O L M
- Training Loss
- Fineweb Edu
- Gpt 2 Small
- Standard Dataset
- Spectral
- Soft Attractors
- S1 S3 S4
- Model Architecture
- Training Loss Metric
- Anchorkan O Lm
- Eval State 242
- Architecture
- Mechanism
- Antenna
- Finite Attractor Mechanism
- Stable Finite Identity Attractors
- Should Now Be Fired
- Soft Finite Attractors
- Fix
- Discrete Identity Coding
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.