Move evaluations to src/

This commit is contained in:
Yiorgis Gozadinos 2025-09-30 13:21:53 +03:00
parent 6bcc251e5d
commit 43b9cd50ba
No known key found for this signature in database
10 changed files with 3 additions and 3 deletions

2
.gitignore vendored
View file

@ -11,7 +11,7 @@ wheels/
# tests # tests
.coverage* .coverage*
evaluations/data/ src/evaluations/data/
tests/data/ tests/data/
.pytest_cache/ .pytest_cache/
.ruff_cache/ .ruff_cache/

View file

@ -3,7 +3,7 @@
We use the [repliqa](https://huggingface.co/datasets/ServiceNow/repliqa) dataset for the evaluation of `haiku.rag`. We use the [repliqa](https://huggingface.co/datasets/ServiceNow/repliqa) dataset for the evaluation of `haiku.rag`.
You can perform your own evaluations with the Typer CLI in You can perform your own evaluations with the Typer CLI in
`evaluations/benchmark.py`, for example `python -m evaluations.benchmark repliqa`. `src/evaluations/benchmark.py`, for example `cd src && python -m evaluations.benchmark repliqa`.
The evaluation flow is orchestrated with The evaluation flow is orchestrated with
[`pydantic-evals`](https://github.com/pydantic/pydantic-ai/tree/main/libs/pydantic-evals), [`pydantic-evals`](https://github.com/pydantic/pydantic-ai/tree/main/libs/pydantic-evals),
which we leverage for dataset management, scoring, and report generation. which we leverage for dataset management, scoring, and report generation.

View file

@ -49,7 +49,7 @@ requires = ["hatchling"]
build-backend = "hatchling.build" build-backend = "hatchling.build"
[tool.hatch.build] [tool.hatch.build]
exclude = ["/docs", "/evaluations", "/tests", "/.github"] exclude = ["/docs", "/tests", "/.github"]
[tool.hatch.build.targets.wheel] [tool.hatch.build.targets.wheel]
packages = ["src/haiku"] packages = ["src/haiku"]