ba760b76c2
The runner passed document_filter onto capability state but not sources, so an eval case could not be scoped to named databases. Scoping is what the multi-database acceptance dataset has to assert, both that a scoped question honours its databases and that an empty scope refuses rather than answering without evidence. sources=[] covers no database while None covers every one the client covers, so the empty list is threaded on an is-not-None check and a test pins the two apart. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_benchmark.py | ||
| test_capability_runner.py | ||
| test_citation_evaluators.py | ||
| test_config.py | ||
| test_conversation_evaluator.py | ||
| test_datasets.py | ||
| test_evaluators.py | ||
| test_mtrag.py | ||
| test_numbers.py | ||
| test_reference_configs.py | ||
| test_submission.py | ||