haiku.rag/evaluations/evaluations
Yiorgis Gozadinos 392c74039b
bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17
Migrate off two APIs slated for removal in pydantic-ai 2.0:

- Agent(tool_retries=, output_retries=) -> Agent(retries={"tools": ...,
  "output": ...}) in the LLM-as-judge evaluator.
- Evaluator.evaluation_name class attribute -> overriding
  get_default_evaluation_name() on the citation MRR / MAP evaluators.

haiku.skills 0.17.0 already migrated its internal AGUIAdapter,
MCPToolset and ProcessEventStream usage; no further changes needed on
our side beyond the pin bumps.
2026-05-21 13:20:54 +03:00
..
datasets split open_rag_bench dataset into orb_text and orb_multimodal variants 2026-05-06 12:49:03 +03:00
evaluators bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17 2026-05-21 13:20:54 +03:00
__init__.py Restructure into uv workspace to support minimal and full installations 2025-11-04 17:59:12 +02:00
benchmark.py evaluations: judge model moves to config.evaluations.judge 2026-05-20 12:56:22 +03:00
config.py remove dataset-specific system prompts 2026-04-28 14:33:25 +03:00
skill_runner.py Drop the multi-agent research workflow 2026-05-20 12:46:48 +03:00