evaluation execution
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-11.)
evaluation execution has 17 facts recorded in Dontopedia across 3 references, with 4 live disagreements.
Mostly:extracts(2), initializes(2), assigns to list(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (4)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
collectivelyEnableCollectively Enable(1)
- Dataset Components
ex:dataset-components
describesDescribes(1)
- Commentary 6
ex:commentary-6
isGoalOfIs Goal of(1)
- Binary Relevance Vectors
ex:binary-relevance-vectors
isPrerequisiteIs Prerequisite(1)
- Dataset Collection
ex:dataset-collection
Other facts (16)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Extracts | Ground Truth Documents | [2] |
| Extracts | Retrieved Documents | [2] |
| Initializes | Y True | [2] |
| Initializes | Y Pred | [2] |
| Assigns to List | Y True | [2] |
| Assigns to List | Y Pred | [2] |
| Unpacks Row | Ground Truth Documents | [2] |
| Unpacks Row | Retrieved Documents | [2] |
| Rdf:type | Assessment Activity | [1] |
| Iterates Over | Test Data | [2] |
| Converts to | Binary Relevance Vectors | [2] |
| Iterates With | For Loop | [2] |
| Performs Split | Comma Separator | [2] |
| Calls Function | Evaluate Reformulation | [3] |
| Stores Result | Accuracy and Reformulated Outputs | [3] |
| Is Described by | Commentary 6 | [3] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (3)
ctx:claims/beam/241122f8-dc34-4876-8384-3647f4796af6- full textbeam-chunktext/plain1 KB
doc:beam/241122f8-dc34-4876-8384-3647f4796af6Show excerpt
self.tokenizer = tokenizer def process_query(self, query, context=None): # Reformulate the query reformulated_query = reformulate_query(query, context) # Process the reformulated query (e.g., retrieve r…
ctx:claims/beam/34a1dce2-ecc2-4241-ad4a-235e8625b612- full textbeam-chunktext/plain1 KB
doc:beam/34a1dce2-ecc2-4241-ad4a-235e8625b612Show excerpt
retrieved_documents = rag_system.process_query(reformulated_query, context) return reformulated_query, retrieved_documents # Apply the function to each row df[['reformulated_query', 'retrieved_documents']] = df.apply( lambda ro…
ctx:claims/beam/7a6d20d2-0f32-4ba7-b3bb-8b64e897ee99- full textbeam-chunktext/plain1 KB
doc:beam/7a6d20d2-0f32-4ba7-b3bb-8b64e897ee99Show excerpt
logging.error(f'Error in PostProcessor for text "{text}": {e}') return text # Define the evaluation function def evaluate_reformulation(stages, inputs, outputs): # Apply the reformulation stages to the inputs …
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.