haiku.rag/evaluations/tests
Yiorgis Gozadinos eed820df1b
Evaluate over a configured set of databases
The runner passed the dataset's path to every arm, which opens one database
and is what makes `--db` meaningful. A run over `lancedb.databases` has to
pass none instead, so the client resolves the set, and `DatasetSpec.covers_a_set`
is the one place that decides which of the two a run is.
2026-08-24 10:03:47 +03:00
..
__init__.py
test_benchmark.py Split the evaluation benchmark by responsibility 2026-08-20 14:08:09 +03:00
test_capability_runner.py Thread the document filter through the live QA runner 2026-08-17 11:03:52 +03:00
test_citation_evaluators.py Add MTRAG ClapNQ multi-turn evaluation 2026-08-17 10:53:16 +03:00
test_config.py Evaluate over a configured set of databases 2026-08-24 10:03:47 +03:00
test_conversation_evaluator.py Add MTRAG ClapNQ multi-turn evaluation 2026-08-17 10:53:16 +03:00
test_datasets.py Add stable ids to FRAMES question rows 2026-08-24 09:03:44 +03:00
test_evaluators.py Add MTRAG ClapNQ multi-turn evaluation 2026-08-17 10:53:16 +03:00
test_mtrag.py Simplify the eval harness and share the embed-fill path. 2026-08-17 10:56:26 +03:00
test_numbers.py Normalize unicode signs 2026-06-06 14:52:04 +03:00
test_reference_configs.py Pin the eval judge to qwen3.8 2026-08-18 14:28:16 +03:00
test_submission.py Add T²-RAGBench leaderboard submission exporter 2026-06-08 11:51:02 +03:00