The `--filter` examples used `uri LIKE '%arxiv%'`, which matches no `orb_text` document: its URIs are bare arXiv ids such as `2407.01528v3`. A clause that matches nothing scores MAP 0 rather than erroring, so the example failed silently. `await_args` is typed `_Call | None`, so subscripting it fails `ty check`; `call_args` carries the same call for an AsyncMock. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_benchmark.py | ||
| test_capability_runner.py | ||
| test_citation_evaluators.py | ||
| test_config.py | ||
| test_datasets.py | ||
| test_evaluators.py | ||
| test_numbers.py | ||
| test_reference_configs.py | ||
| test_submission.py | ||