Yiorgis Gozadinos
|
e8e67d336c
|
Fix get_model() uses where default Config is forced
|
2025-12-18 15:10:31 +02:00 |
|
Yiorgis Gozadinos
|
1dbbaf6dd8
|
vb
|
2025-12-18 12:21:16 +02:00 |
|
Yiorgis Gozadinos
|
40e0ea090d
|
Add option to override vacuum interval
|
2025-12-12 16:04:06 +02:00 |
|
Yiorgis Gozadinos
|
056b9ad090
|
Use periodic vacuum to prevent disk exhaustion with large datasets
|
2025-12-12 15:53:23 +02:00 |
|
Yiorgis Gozadinos
|
7526735059
|
hotpotqa adapter
|
2025-12-12 10:56:37 +02:00 |
|
Yiorgis Gozadinos
|
f6073a0db9
|
vb
|
2025-12-12 10:48:21 +02:00 |
|
Yiorgis Gozadinos
|
00d621e211
|
vb
|
2025-12-11 16:31:21 +02:00 |
|
Yiorgis Gozadinos
|
802f058205
|
Move search related config under SearchConfig
|
2025-12-09 12:28:28 +02:00 |
|
Yiorgis Gozadinos
|
06b4f6a224
|
Add format parameter for text-to-DoclingDocument conversion
|
2025-12-08 15:56:21 +02:00 |
|
Yiorgis Gozadinos
|
9a5f8e4368
|
Add type-aware context expansion for search results
|
2025-12-08 15:56:21 +02:00 |
|
Yiorgis Gozadinos
|
dab04668bd
|
Dependency updates
|
2025-12-08 15:56:02 +02:00 |
|
Yiorgis Gozadinos
|
a57203065a
|
Fix test
|
2025-12-08 15:55:28 +02:00 |
|
Yiorgis Gozadinos
|
d808c6c425
|
Simplify citations in qa & graph agents
|
2025-12-08 15:55:27 +02:00 |
|
Yiorgis Gozadinos
|
ace58a7034
|
Update evaluations and a2a
|
2025-12-08 15:54:56 +02:00 |
|
Yiorgis Gozadinos
|
fe4ac530be
|
DB migration
|
2025-12-08 15:54:56 +02:00 |
|
Yiorgis Gozadinos
|
3525fae625
|
Use EmbeddingModelConfig similar to ModelConfig for embeddings
|
2025-12-02 11:55:31 +02:00 |
|
Yiorgis Gozadinos
|
f07590bd5b
|
vb
|
2025-12-01 17:58:47 +02:00 |
|
Yiorgis Gozadinos
|
10aa2a7cf2
|
vb
|
2025-11-28 10:15:59 +02:00 |
|
Yiorgis Gozadinos
|
eee29578ba
|
vb
|
2025-11-27 15:24:39 +02:00 |
|
Yiorgis Gozadinos
|
3959ce39f7
|
vb
|
2025-11-27 13:06:04 +02:00 |
|
Yiorgis Gozadinos
|
ca2445d869
|
vb
|
2025-11-26 10:33:46 +02:00 |
|
Yiorgis Gozadinos
|
c22a5bb0ce
|
vb
|
2025-11-25 13:44:48 +02:00 |
|
Yiorgis Gozadinos
|
8a8005ead0
|
Add qa/judge models meta to experiment meta
|
2025-11-25 13:09:29 +02:00 |
|
Yiorgis Gozadinos
|
f843fb8140
|
Use non-thinking judge in evals
|
2025-11-25 13:00:25 +02:00 |
|
Yiorgis Gozadinos
|
e83978f88b
|
Revert embeddings to use flat config
|
2025-11-25 12:51:58 +02:00 |
|
Yiorgis Gozadinos
|
a9701616c8
|
Rename model to name under model
|
2025-11-25 12:28:43 +02:00 |
|
Yiorgis Gozadinos
|
1bb7b6d5bd
|
Add support for per-model configuration settings including thinking, temperature and max_tokens
|
2025-11-25 12:14:24 +02:00 |
|
Yiorgis Gozadinos
|
4e1752a740
|
Default eval db location, evaluation script
|
2025-11-25 11:07:20 +02:00 |
|
Yiorgis Gozadinos
|
b5892699a0
|
Use Mean Reciprocal Rank for single document evaluation as metric. Use Mean Average Precision for variable document evaluation as metric
|
2025-11-24 14:49:30 +02:00 |
|
Yiorgis Gozadinos
|
8d0846b88a
|
Record useful meta in the experiment
|
2025-11-24 10:46:25 +02:00 |
|
Yiorgis Gozadinos
|
ada2b66d5b
|
vb
|
2025-11-21 16:38:52 +02:00 |
|
Yiorgis Gozadinos
|
63b374c7e9
|
Name evaluation runs. Use only LLMJudge evaluator.
|
2025-11-21 13:26:39 +02:00 |
|
Yiorgis Gozadinos
|
09900f8e8b
|
vb
|
2025-11-19 13:08:37 +02:00 |
|
Yiorgis Gozadinos
|
0ea5f1e10e
|
Update dependencies
|
2025-11-19 10:24:37 +02:00 |
|
Yiorgis Gozadinos
|
826986708d
|
vb
|
2025-11-18 15:52:52 +02:00 |
|
Yiorgis Gozadinos
|
efbd5b92f7
|
vb
|
2025-11-17 16:30:39 +02:00 |
|
Yiorgis Gozadinos
|
636d5261e6
|
vb
|
2025-11-14 22:29:37 +02:00 |
|
Yiorgis Gozadinos
|
adb7d9093d
|
Run entire evaluation dataset as one so that it appears properly in logfire
|
2025-11-14 11:39:58 +02:00 |
|
Yiorgis Gozadinos
|
c8999a89b8
|
Update and lock pydantic-ai-slim
|
2025-11-14 11:26:09 +02:00 |
|
Yiorgis Gozadinos
|
f55b8c8f19
|
Load .env in evals
|
2025-11-14 11:00:58 +02:00 |
|
Yiorgis Gozadinos
|
6eb0d59a28
|
vb
|
2025-11-13 15:00:57 +02:00 |
|
Yiorgis Gozadinos
|
34f50f37a0
|
vb
|
2025-11-07 14:44:58 +02:00 |
|
Yiorgis Gozadinos
|
0e3f2ebd67
|
vb
|
2025-11-06 16:13:53 +02:00 |
|
Yiorgis Gozadinos
|
8da62e3868
|
Known-first party for ruff evaluations
|
2025-11-06 11:01:12 +02:00 |
|
Yiorgis Gozadinos
|
b8bc6d9b68
|
Let ruff know about our package structure
|
2025-11-05 17:47:27 +02:00 |
|
Yiorgis Gozadinos
|
21bb7b5aab
|
Version bump & Changelog
|
2025-11-05 13:16:03 +02:00 |
|
Yiorgis Gozadinos
|
009e529869
|
No need to have evaluations in the docker image
|
2025-11-05 12:35:37 +02:00 |
|
Yiorgis Gozadinos
|
ba8e503cb1
|
Depend on pydantic-ai-slim with extras
|
2025-11-05 11:37:06 +02:00 |
|
Yiorgis Gozadinos
|
f06dac7102
|
Update READMEs
|
2025-11-05 10:47:00 +02:00 |
|
Yiorgis Gozadinos
|
2f9c907031
|
Restructure into uv workspace to support minimal and full installations
|
2025-11-04 17:59:12 +02:00 |
|