Human evaluation of Mistral 7B – Instruct vs Llama 2 13B – Chat Example
From Dontopedia, the open, paraconsistent wiki. (Last updated 2026-07-03.)
Human evaluation of Mistral 7B – Instruct vs Llama 2 13B – Chat Example has 8 facts recorded in Dontopedia across 3 references, with 2 live disagreements.
Mostly:rdf:type(3), compares(2), conducted on(1)
Maturity scale
raw canonical shape-checked rule-derived certifiedInbound mentions (2)
Other subjects in dontopedia point AT this entity as a value. These are inverse relationships — e.g. "X motherOf this subject" — and answer questions the forward facts can't. Grouped by predicate.
basedOnBased on(1)
- Define Accuracy Metric
ex:define-accuracy-metric
mentionsMethodMentions Method(1)
- Evaluation Consideration
ex:evaluation-consideration
Other facts (7)
The long tail: predicates that appear too rarely to warrant their own section. Filter or scroll to find a specific one. Each row links to its source.
| Predicate | Value | Ref |
|---|---|---|
| Rdf:type | Evaluation Method | [1] |
| Rdf:type | Evaluation Method | [2] |
| Rdf:type | Figure | [3] |
| Compares | Mistral 7b Instruct | [3] |
| Compares | Llama 2 13b Chat | [3] |
| Conducted on | Leaderboard | [3] |
| Source | Llmboxing Com | [3] |
Timeline
Timeline axis is valid_time — when each source says the fact was true in the world, not when Dontopedia learned about it. Retracted rows are kept for provenance; coloured stripes indicate the context kind.
References (3)
ctx:claims/beam/5fac4cc5-62c6-4b3f-9064-15f4806ba3b5- full textbeam-chunktext/plain1 KB
doc:beam/5fac4cc5-62c6-4b3f-9064-15f4806ba3b5Show excerpt
[[1, 2, 3, 4, 5, 6, 7, 8, 9, 10], [9, 10, 11, 12, 13, 14, 15, 16, 17, 18], [17, 18, 19, 20]] ``` ### Additional Considerations 1. **Tokenization**: - If your input data is text, ensure that you tokenize it appropriately before segmenti…
ctx:claims/beam/8563ca84-0d37-48e4-9de6-fd9401a1de41- full textbeam-chunktext/plain1 KB
doc:beam/8563ca84-0d37-48e4-9de6-fd9401a1de41Show excerpt
By implementing these optimizations, you should be able to reduce the processing time and improve the performance of your spelling correction module. [Turn 10240] User: I'm working on a project to improve the search accuracy of our RAG sys…
ctx:claims/document/013ce683-54a9-49ec-a919-ea7a77edb6f6- full textmistral7b.txttext/plain24 KB
donto:blob/sha256/a1ee205dee010ebc8a172066f2792e57b67f168f495aed1deef4f7f99b144731Show excerpt
Mistral 7B arXiv:2310.06825v1 [cs.CL] 10 Oct 2023 Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Léli…
See also
Keep researching
Missing something or suspicious of what's here? Kick off a research session — a Claude agent will investigate, cite its sources, and file new facts into a dedicated context you can review before accepting into the shared view.