LLM evaluation
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-06-06.)
LLM evaluation has 20 facts recorded in Dontopedia across 5 references, with 5 live disagreements.
Mostly:rdf:type(4), considers factor(3), produces(2)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (6)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
coveredByCovered by(1)
- Llm Hosting Trade Offs
ex:llm-hosting-trade-offs
demonstratesDemonstrates(1)
- Example Usage
ex:example-usage
hasPurposeHas Purpose(1)
- Llm Evaluator
ex:llm-evaluator
hasStepHas Step(1)
- Evaluation Process
ex:evaluation-process
subjectOfSubject of(1)
- Llm Hosting Trade Offs
ex:llm-hosting-trade-offs
topicTopic(1)
- Arize Llm Evaluation
ex:arize-llm-evaluation
Other facts (17)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Evaluation Context | [2] |
| Rdf:type | Action | [3] |
| Rdf:type | Process | [4] |
| Rdf:type | Process | [5] |
| Considers Factor | Cost | [1] |
| Considers Factor | Performance | [1] |
| Considers Factor | Data Privacy | [1] |
| Produces | Normalised Score | [3] |
| Produces | Normalized Score | [5] |
| Based on | Criteria | [5] |
| Based on | Weights | [5] |
| Designed for | Llm Hosting Trade Offs | [1] |
| Covers | Llm Hosting Trade Offs | [1] |
| Context for | Progress Tracking | [2] |
| Performed by | Llm Evaluator | [5] |
| Applied to | enterprise systems | [5] |
| Method | Llm Evaluator | [5] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (5)
ctx:claims/beam/f5ccca0f-5f03-47b2-93f1-d6f2f4ac4189ctx:claims/beam/5a070b90-b8d1-4da4-930d-fb1cc64d58c0- full textbeam-chunktext/plain1 KB
doc:beam/5a070b90-b8d1-4da4-930d-fb1cc64d58c0Show excerpt
- `conn.close()`: Close the database connection. ### Example Execution Run the script to create the database, insert a row, and retrieve the data. You should see output similar to the following: ```plaintext ID: 1, Provider: Provider …
ctx:claims/beam/6c30720a-3df4-47ac-981d-ec8baa26852a- full textbeam-chunktext/plain1 KB
doc:beam/6c30720a-3df4-47ac-981d-ec8baa26852aShow excerpt
- You can easily add more criteria by extending the `criteria` list and implementing the corresponding normalization functions. ### Example Usage In the example usage, we define three criteria (`accuracy`, `latency`, `cost`) and assign…
ctx:claims/beam/ae9da787-9532-40de-9f02-5b4cf72c688b- full textbeam-chunktext/plain1 KB
doc:beam/ae9da787-9532-40de-9f02-5b4cf72c688bShow excerpt
2. **Normalization Function**: Implemented `_normalize_reliability` to normalize the reliability metric to a 0-1 scale. The threshold is set to 99.9%, which is a common target for enterprise systems. 3. **Updated Weights**: Adjusted the wei…
ctx:claims/beam/f5dbd22c-5e45-4e0d-82c8-ff4f046e61af
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.