corpus
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-09.)
corpus has 50 facts recorded in Dontopedia across 20 references, with 5 live disagreements.
Mostly:rdf:type(8), contains(3), has tokens(3)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (11)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
usesArgumentUses Argument(4)
- Hdp Model
ex:hdp_model - Hdp Model Instantiation
ex:hdp-model-instantiation - Lsi Model
ex:lsi_model - Lsi Model Instantiation
ex:lsi-model-instantiation
dividesDivides(1)
- Stratified Sampling
ex:stratified-sampling
hasNewlinesStrippedHas Newlines Stripped(1)
- Python Tutorial Fragments
ex:python-tutorial-fragments
initializedWithInitialized With(1)
- Bm25 Variable
ex:bm25-variable
isInitializedWithIs Initialized With(1)
- Bm25 Variable
ex:bm25-variable
isMostlyDueToIs Mostly Due to(1)
- Bpb Delta
ex:bpb-delta
providesStatusUpdateProvides Status Update(1)
- Lisamegawatts
ex:lisamegawatts
takesInputTakes Input(1)
- Analyze Corpus
ex:analyze-corpus
Other facts (45)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Python Variable | [13] |
| Rdf:type | Dataset | [13] |
| Rdf:type | Dataset | [15] |
| Rdf:type | Dataset | [16] |
| Rdf:type | Text Dataset | [17] |
| Rdf:type | Data Set | [18] |
| Rdf:type | Data Structure | [19] |
| Rdf:type | List | [20] |
| Contains | Python Tutorial Fragments | [2] |
| Contains | Python tutorial fragments | [15] |
| Contains | Token Lists | [20] |
| Has Tokens | 35.6M | [4] |
| Has Tokens | 133000000 | [5] |
| Has Tokens | 133000000 | [6] |
| Prerequisite for | Lsi Model | [13] |
| Prerequisite for | Hdp Model | [13] |
| Normalized to | 26 letters, space, and punctuation for total 38 | [1] |
| Format Issue | Newlines Stripped | [2] |
| Trains Model | Model | [2] |
| Presupposes Mixture | Wiki Philosophy | [3] |
| Contains Mix | Wikipedia Style Text | [3] |
| Has Sequences | 332882 | [4] |
| Token Count | 133M | [5] |
| Has Size Tokens | 133000000 | [6] |
| Divided by Batch Size | 4096 | [6] |
| Lacks Eot | null | [7] |
| Is Raw Text | concatenated | [7] |
| Probably Is More Complex | Doremi Setup | [8] |
| Is Just Played Through | Streaming | [8] |
| Is More Complex Than | Doremi Setup | [8] |
| Is Not Ordered | Or Not Ordering | [8] |
| Much Larger Than Batch | 54x | [9] |
| Associated With Repo | Monumentalsystems Chinchilla Master Corpus V1 | [10] |
| Is Still Building | true | [10] |
| Requires Building | true | [10] |
| Lacks | Clean Death Record Claim | [11] |
| Has Biographical Detail on | Jessie Mossman Bawanya | [11] |
| As of Date | 2026-05-31 | [12] |
| Growth Status | growing | [12] |
| Is Divided by | Stratified Sampling | [14] |
| Has Sequence Count | 332882 | [16] |
| Has Token Count | 35600000 | [16] |
| Composition | raw text concatenated | [17] |
| Is Derived From | Train Df Tokens | [20] |
| Consists of | Tokenized Documents | [20] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (20)
ctx:discord/blah/katbot/part-3ctx:discord/blah/safiersemantics/part-79ctx:discord/blah/watt-activation/part-32ctx:discord/blah/watt-activation/part-84ctx:discord/blah/watt-activation/part-89ctx:discord/blah/watt-activation/part-91ctx:discord/blah/watt-activation/part-129ctx:discord/blah/watt-activation/part-695ctx:discord/blah/watt-activation/part-702ctx:discord/blah/watt-activation/part-703ctx:genes/bennet-walker-2026-05-20ctx:genes/val-mauritius/dossier-FAMILY-INDEXctx:claims/beam/29eb6045-85ca-4c16-aabb-7adceec47390- full textbeam-chunktext/plain1 KB
doc:beam/29eb6045-85ca-4c16-aabb-7adceec47390Show excerpt
from gensim.models import LsiModel, HdpModel # Perform LSI lsi_model = LsiModel(corpus, num_topics=5, id2word=dictionary) # Print the topics topics = lsi_model.print_topics() print(topics) # Perform HDP hdp_model = HdpModel(corpus, id2wo…
ctx:claims/beam/45af0c7a-a92b-45bf-b1f4-496260d16f7b- full textbeam-chunktext/plain1 KB
doc:beam/45af0c7a-a92b-45bf-b1f4-496260d16f7bShow excerpt
By using stratified sampling and weighted sampling, you can account for the variability in document sizes and improve the accuracy of your volume estimation. This approach ensures that each type of document is adequately represented in the …
ctx:discord/blah/safiersemantics/77- full textsafiersemantics-77text/plain3 KB
doc:agent/safiersemantics-77/44c2a4ed-2103-4ae6-a8d3-39339a1ed0c3Show excerpt
[2026-04-29 01:32] xenonfun: last I saw was 32GB of swap and the server isn't responding but proof of concept works [2026-04-29 02:07] xenonfun: private repo runs showing in ci, tho now gotta get them working correct (files: Screenshot_2026…
ctx:discord/blah/watt-activation/84- full textwatt-activation-84text/plain3 KB
doc:agent/watt-activation-84/16e41088-c84d-4a6f-9c2d-56d69830cfa6Show excerpt
[2026-03-07 20:41] xenonfun: okay some instant issues with this much data: ``` The problem: mx.eval(loss, model.parameters(), optimizer.state) traverses the full tree of 113M params + Adam's 2x state every step. For the compiled path, mx.ev…
ctx:discord/blah/watt-activation/129- full textwatt-activation-129text/plain3 KB
doc:agent/watt-activation-129/64745479-5d89-4d07-a9b4-ab8506f11ac1Show excerpt
[2026-03-09 04:37] xenonfun: Prompt: 'The theory of' ──────────────────────────────────────────────────────────── The theory of the United States. The American 5th century that was also be seen to bring on 3,000th century. We were 1 in 1956…
ctx:claims/beam/19298204-c17d-4ff3-9158-f6e8c9bd1fa6- full textbeam-chunktext/plain1 KB
doc:beam/19298204-c17d-4ff3-9158-f6e8c9bd1fa6Show excerpt
3. **Adjust based on observed performance**: - Increase shards if you need to distribute data more evenly. - Increase replicas if you need to distribute read load or improve fault tolerance. 4. **Test changes incrementally** to ensure…
ctx:claims/beam/fac7b295-c13f-4a70-a0ab-5144053a3215- full textbeam-chunktext/plain1 KB
doc:beam/fac7b295-c13f-4a70-a0ab-5144053a3215Show excerpt
### Step-by-Step Script 1. **Install Required Libraries**: Ensure you have the necessary libraries installed: ```sh pip install pandas elasticsearch ``` 2. **Script to Analyze Corpus and Integrate with Elasticsearch**: ```pyt…
ctx:claims/beam/46068d53-96d3-4709-a18e-0c4041019936- full textbeam-chunktext/plain1 KB
doc:beam/46068d53-96d3-4709-a18e-0c4041019936Show excerpt
### Step 2: Modify the Code to Use BM25 Here's an example of how you can integrate BM25 into your proof of concept: ```python import pandas as pd from sklearn.model_selection import train_test_split from sklearn.metrics import recall_scor…
See also
- Python Tutorial Fragments
- Newlines Stripped
- Model
- Wiki Philosophy
- Wikipedia Style Text
- Doremi Setup
- Streaming
- Or Not Ordering
- 54x
- Monumentalsystems Chinchilla Master Corpus V1
- Clean Death Record Claim
- Jessie Mossman Bawanya
- Python Variable
- Lsi Model
- Hdp Model
- Dataset
- Stratified Sampling
- Text Dataset
- Data Set
- Data Structure
- List
- Train Df Tokens
- Tokenized Documents
- Token Lists
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.