haiku.rag/evaluations/evaluations
Yiorgis Gozadinos 2bbd949a29
Record the database each citation came from
A run over several databases could report which documents were cited but
not which database grounded the answer: `_result_from_run` walked the
citation index for `document_uri` and dropped `Citation.source`. The
distribution is not recoverable from the report afterwards, so a sharded
run would have measured everything except attribution.

`cited_sources` is one entry per cited chunk, in citation order, empty
where the database is unnamed.
2026-08-24 10:03:47 +03:00
..
datasets Add stable ids to FRAMES question rows 2026-08-24 09:03:44 +03:00
evaluators Simplify the eval harness and share the embed-fill path. 2026-08-17 10:56:26 +03:00
__init__.py Restructure into uv workspace to support minimal and full installations 2025-11-04 17:59:12 +02:00
artifacts.py Split the evaluation benchmark by responsibility 2026-08-20 14:08:09 +03:00
benchmark.py Split the evaluation benchmark by responsibility 2026-08-20 14:08:09 +03:00
capability_runner.py Record the database each citation came from 2026-08-24 10:03:47 +03:00
config.py Evaluate over a configured set of databases 2026-08-24 10:03:47 +03:00
experiment.py Split the evaluation benchmark by responsibility 2026-08-20 14:08:09 +03:00
numbers.py Normalize unicode signs 2026-06-06 14:52:04 +03:00
population.py Split the evaluation benchmark by responsibility 2026-08-20 14:08:09 +03:00
qa.py Record the database each citation came from 2026-08-24 10:03:47 +03:00
retrieval.py Evaluate over a configured set of databases 2026-08-24 10:03:47 +03:00
submission.py replace haiku.skills with native Pydantic AI capabilities 2026-07-24 15:26:17 +03:00