haiku.rag/evaluations/tests
Yiorgis Gozadinos 392c74039b
bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17
Migrate off two APIs slated for removal in pydantic-ai 2.0:

- Agent(tool_retries=, output_retries=) -> Agent(retries={"tools": ...,
  "output": ...}) in the LLM-as-judge evaluator.
- Evaluator.evaluation_name class attribute -> overriding
  get_default_evaluation_name() on the citation MRR / MAP evaluators.

haiku.skills 0.17.0 already migrated its internal AGUIAdapter,
MCPToolset and ProcessEventStream usage; no further changes needed on
our side beyond the pin bumps.
2026-05-21 13:20:54 +03:00
..
__init__.py
test_benchmark.py Drop GEPA prompt optimization and --target qa from evaluations 2026-05-19 11:01:07 +03:00
test_citation_evaluators.py bump pydantic-ai-slim to 1.100 and haiku.skills to 0.17 2026-05-21 13:20:54 +03:00
test_config.py remove dataset-specific system prompts 2026-04-28 14:33:25 +03:00
test_datasets.py Update core dependencies 2026-04-03 10:14:27 +03:00
test_evaluators.py Test evaluations 2026-03-12 12:05:50 +02:00
test_skill_runner.py Drop the multi-agent research workflow 2026-05-20 12:46:48 +03:00