test dataset
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-11.)
test dataset has 47 facts recorded in Dontopedia across 12 references, with 8 live disagreements.
Mostly:rdf:type(8), has property(3), has field(3)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (19)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
evaluateMethodCallEvaluate Method Call(2)
- Trainer Falcon
ex:trainer-falcon - Trainer Llama
ex:trainer-llama
measuredOnMeasured on(2)
- Accuracy Achievement
ex:accuracy-achievement - Accuracy Metric
ex:accuracy-metric
rdf:typeRdf:type(2)
- 4000 Queries
ex:4000-queries - 5000 Test Queries
ex:5000-test-queries
hasEvalDatasetHas Eval Dataset(1)
- Trainer
ex:trainer
isEvaluatedOnIs Evaluated on(1)
- Model
ex:model
isPerformedOnIs Performed on(1)
- Evaluation
ex:evaluation
partOfPart of(1)
- Test Encodings
ex:test-encodings
presentInPresent in(1)
- Inconsistencies
ex:inconsistencies
processesProcesses(1)
- Performance Evaluation
ex:performance-evaluation
producesProduces(1)
- Test Dataset Generation
ex:test-dataset-generation
requiresRequires(1)
- Test and Validate
ex:test-and-validate
results-inResults in(1)
- Step 1
ex:step-1
testedOnTested on(1)
- Accuracy Achievement
ex:accuracy-achievement
validationMethodValidation Method(1)
- Accuracy Achievement
ex:accuracy-achievement
Other facts (44)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Dataset | [2] |
| Rdf:type | Dataset | [3] |
| Rdf:type | Dataset | [6] |
| Rdf:type | Text Dataset | [7] |
| Rdf:type | Test Dataset | [8] |
| Rdf:type | Dataset | [9] |
| Rdf:type | Diverse Dataset | [10] |
| Rdf:type | Dataset | [12] |
| Has Property | inconsistencies | [3] |
| Has Property | Inconsistencies | [6] |
| Has Property | test | [8] |
| Has Field | Name Field | [5] |
| Has Field | Age Field | [5] |
| Has Field | Date Field | [5] |
| Size | 1500 | [8] |
| Size | 15000 | [10] |
| Size | 15000 | [11] |
| Contains Column | Name Column | [6] |
| Contains Column | Age Column | [6] |
| Has Size | 1500 | [8] |
| Has Size | 6000 | [9] |
| Contains | common-misspellings | [10] |
| Contains | edge-cases | [10] |
| Total Lifetime | 984 | [1] |
| Record Count | 10000 | [3] |
| Intended Use | Openrefine Performance Testing | [4] |
| Has Entries Count | 20000 | [5] |
| Has Inconsistencies | Yes | [5] |
| Output Format | Csv | [5] |
| Output Filename | test_dataset.csv | [5] |
| Created From | Data Dictionary | [5] |
| Is Output of | Step 1 | [5] |
| Generated by | Test Dataset Generation | [6] |
| Has Part | Test Encodings | [7] |
| Used in | Accuracy Achievement | [8] |
| Used for Validation | Accuracy Achievement | [8] |
| Has Unit | interactions | [9] |
| Is Measured by | Accuracy Metric | [9] |
| Should Represent | real-world-usage-scenarios | [10] |
| Property | diverse | [11] |
| Is Used by | Trainer | [12] |
| Is Consumed by | Trainer | [12] |
| Is Used for | Evaluation | [12] |
| Is Used for Evaluation | Model | [12] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (12)
ctx:discord/blah/watt-activation/part-512ctx:claims/beam/eeee12e5-48f7-4435-bf8a-e4edf5c6c9c2- full textbeam-chunktext/plain1 KB
doc:beam/eeee12e5-48f7-4435-bf8a-e4edf5c6c9c2Show excerpt
tokenizer=falcon_tokenizer, ) # Train the models trainer_llama.train() trainer_falcon.train() # Evaluate the models results_llama = trainer_llama.evaluate(test_dataset) results_falcon = trainer_falcon.evaluate(test_dataset) print(f"L…
ctx:claims/beam/4bf72c19-e147-4c83-b922-030035464495ctx:claims/beam/b00c301c-c592-4cd6-ad07-b1de426fb5c4- full textbeam-chunktext/plain970 B
doc:beam/b00c301c-c592-4cd6-ad07-b1de426fb5c4Show excerpt
This approach should help you identify the most common date formats in your dataset and pinpoint the root cause of the inconsistencies. [Turn 4500] User: I want to evaluate the performance of OpenRefine in cleaning metadata. Can you help m…
ctx:claims/beam/336f50f5-6e67-42bf-b2f1-406aa219718e- full textbeam-chunktext/plain1 KB
doc:beam/336f50f5-6e67-42bf-b2f1-406aa219718eShow excerpt
[Turn 4501] Assistant: Certainly! To evaluate the performance of OpenRefine in cleaning metadata, you can generate a test dataset with various inconsistencies and then compare the results of OpenRefine's cleaning against a manually cleaned …
ctx:claims/beam/abbe86bc-57a3-4347-aab0-645abb0507b7- full textbeam-chunktext/plain1 KB
doc:beam/abbe86bc-57a3-4347-aab0-645abb0507b7Show excerpt
# Define a function to compare the two datasets def compare_cleaning(openrefine, manual): # Calculate the number of matching entries matches = 0 for index, row in openrefine.iterrows(): if row.equals(manual.loc[index]): …
ctx:claims/beam/20f0272f-7b57-4162-9e25-c21ae614367b- full textbeam-chunktext/plain1 KB
doc:beam/20f0272f-7b57-4162-9e25-c21ae614367bShow excerpt
train_text, test_text, train_labels, test_labels = train_test_split(df['text'], df['label'], test_size=0.2, random_state= 42) # Load a pre-trained multi-language model model_name = 'distilbert-base-multilingual-cased' tokenizer = AutoToken…
ctx:claims/beam/86a744f9-9e99-4ea1-9cc5-81a5f545d2e0- full textbeam-chunktext/plain944 B
doc:beam/86a744f9-9e99-4ea1-9cc5-81a5f545d2e0Show excerpt
- The segments are returned as a list of token lists. 5. **Caching**: - Use a dictionary (`self.cache`) to store and reuse previously computed contexts based on the token count. ### Example Usage - **Adding Tokens**: Tokens are add…
ctx:claims/beam/d4526f8c-5ed9-4c48-b79f-d9b1387a84d9- full textbeam-chunktext/plain1 KB
doc:beam/d4526f8c-5ed9-4c48-b79f-d9b1387a84d9Show excerpt
- **Log Detailed Information**: Use `exc_info=True` in the logger to include the full traceback in the log. - **Return Meaningful Values**: Return `None` or a default value when an error occurs to indicate failure gracefully. ### Example U…
ctx:claims/beam/f3db389f-8220-443d-a384-68686045d20f- full textbeam-chunktext/plain1 KB
doc:beam/f3db389f-8220-443d-a384-68686045d20fShow excerpt
- Expand the dictionary to cover more common misspellings and domain-specific terms. - Use a Trie data structure for faster lookups and more efficient storage. 2. **Implement Context-Aware Corrections**: - Use a pre-trained langua…
ctx:claims/beam/c249ccfb-cea0-44d2-b952-eb744cad24ed- full textbeam-chunktext/plain1 KB
doc:beam/c249ccfb-cea0-44d2-b952-eb744cad24edShow excerpt
- Determine whether the errors are due to dictionary limitations, context misinterpretation, or other factors. 2. **Refine the Algorithm**: - Adjust the dictionary to cover more misspellings. - Fine-tune the language model on a do…
ctx:claims/beam/f1acc8e8-db39-4556-bbec-0ee7f29aeac4- full textbeam-chunktext/plain1 KB
doc:beam/f1acc8e8-db39-4556-bbec-0ee7f29aeac4Show excerpt
logging_dir='./logs', logging_steps=10, evaluation_strategy="epoch", save_total_limit=2, ) # Define Trainer trainer = Trainer( model=model, args=training_args, train_dataset=train_dataset, eval_dataset=test_…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.