haiku.rag/evaluations/evaluations/evaluators
Yiorgis Gozadinos 392c74039b
bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17
Migrate off two APIs slated for removal in pydantic-ai 2.0:

- Agent(tool_retries=, output_retries=) -> Agent(retries={"tools": ...,
  "output": ...}) in the LLM-as-judge evaluator.
- Evaluator.evaluation_name class attribute -> overriding
  get_default_evaluation_name() on the citation MRR / MAP evaluators.

haiku.skills 0.17.0 already migrated its internal AGUIAdapter,
MCPToolset and ProcessEventStream usage; no further changes needed on
our side beyond the pin bumps.
2026-05-21 13:20:54 +03:00
..
__init__.py citation retrieval scoring 2026-04-28 12:46:16 +03:00
citation.py bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17 2026-05-21 13:20:54 +03:00
judge.py bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17 2026-05-21 13:20:54 +03:00
map.py Use Mean Reciprocal Rank for single document evaluation as metric. Use Mean Average Precision for variable document evaluation as metric 2025-11-24 14:49:30 +02:00
mrr.py Use Mean Reciprocal Rank for single document evaluation as metric. Use Mean Average Precision for variable document evaluation as metric 2025-11-24 14:49:30 +02:00