haiku.rag/evaluations/tests
Yiorgis Gozadinos 721acbcf38
Address review on PR #524
- _budget_notice no longer names the cite tool after prepare_tools has
  withdrawn it; the post-grace state gets the plain no-tools text back.
- Split search-budget rejections from any failed tool call: the code tool
  raises ToolFailed for every error in model-written Python, so
  budget_spent was true for a ZeroDivisionError.
- docs/capabilities/rag.md described the old single-turn removal.
- Drop the rationale clause from the CHANGELOG entry.
2026-07-30 15:50:06 +03:00
..
__init__.py
test_benchmark.py replace haiku.skills with native Pydantic AI capabilities 2026-07-24 15:26:17 +03:00
test_capability_runner.py Address review on PR #524 2026-07-30 15:50:06 +03:00
test_citation_evaluators.py Remove unecessary Mean Reciprocal Rank metric 2026-06-01 10:40:52 +03:00
test_config.py remove dataset-specific system prompts 2026-04-28 14:33:25 +03:00
test_datasets.py Restore hotpotqa evaluation dataset 2026-07-17 16:25:27 +03:00
test_evaluators.py Match the numeric scale convention in Number-Match 2026-06-06 14:52:05 +03:00
test_numbers.py Normalize unicode signs 2026-06-06 14:52:04 +03:00
test_submission.py Add T²-RAGBench leaderboard submission exporter 2026-06-08 11:51:02 +03:00