Reference
Changelog¶
- 2026-11-18: Optional deterministic scoring for the fact categories (
fact-scoring exact_match), and anexact_matchmetric recorded on every fact-category rollout. - 2026-11-17: Data quality checker (
python -m convomem_arena.data_check): structural checks, answer grounding, changing-fact order, filler contamination and duplicates on a persona-spread sample. -
2026-11-16: Judge robustness checker (
python -m convomem_arena.judge_check): one-input-at-a-time paraphrase and meaning-change variants, repeated verdicts, per-judge report. The standalone judge client moved toconvomem_arena.judge_client. -
2026-11-09: Initial release. verifiers v1 taskset with
context/tools/filesmemory modes, official ConvoMem mixing and judges, and retrieval metrics.