Commit graph

63 commits

Author SHA1 Message Date
Yiorgis Gozadinos
8da62e3868
Known-first party for ruff evaluations 2025-11-06 11:01:12 +02:00
Yiorgis Gozadinos
b8bc6d9b68
Let ruff know about our package structure 2025-11-05 17:47:27 +02:00
Yiorgis Gozadinos
21bb7b5aab
Version bump & Changelog 2025-11-05 13:16:03 +02:00
Yiorgis Gozadinos
009e529869
No need to have evaluations in the docker image 2025-11-05 12:35:37 +02:00
Yiorgis Gozadinos
ba8e503cb1
Depend on pydantic-ai-slim with extras 2025-11-05 11:37:06 +02:00
Yiorgis Gozadinos
f06dac7102
Update READMEs 2025-11-05 10:47:00 +02:00
Yiorgis Gozadinos
2f9c907031
Restructure into uv workspace to support minimal and full installations 2025-11-04 17:59:12 +02:00
Yiorgis Gozadinos
43b9cd50ba
Move evaluations to src/ 2025-09-30 13:21:53 +03:00
Yiorgis Gozadinos
abfc796c42
Use gpt-oss for evaluation LLMJudge, allow it to retry if it fails 2025-09-30 11:31:51 +03:00
Yiorgis Gozadinos
9a859c6ee5
Add option to skip db in evals 2025-09-30 11:31:51 +03:00
Yiorgis Gozadinos
842e166041
Adapt how we measure recall when using datasets with multiple sources 2025-09-30 11:31:51 +03:00
Yiorgis Gozadinos
eb2fc67e1c
When populating the eval db, check if chunks for the document have been created. Protects against interrupts 2025-09-30 11:31:50 +03:00
Yiorgis Gozadinos
57e86d00fd
Refactor evaluations so that we can perform with multiple datasets..
Introduce Wix dataset.
2025-09-30 11:31:50 +03:00