Commit graph

63 commits

Author SHA1 Message Date
Yiorgis Gozadinos
92f0fd956f
vb 2026-01-08 10:25:25 +02:00
Yiorgis Gozadinos
ef187767ed
vb 2026-01-07 11:20:48 +02:00
Yiorgis Gozadinos
af340ac410
vb 2026-01-05 12:15:41 +02:00
Yiorgis Gozadinos
271af6cb3c
Update core dependencies 2026-01-05 11:52:38 +02:00
Yiorgis Gozadinos
c9cb005d07
Use FTS on contextualized text 2025-12-29 14:50:07 +02:00
Yiorgis Gozadinos
1f654917b8
vb 2025-12-26 13:56:29 +02:00
Yiorgis Gozadinos
5c7f033d2c
vb 2025-12-19 12:35:35 +02:00
Yiorgis Gozadinos
e8e67d336c
Fix get_model() uses where default Config is forced 2025-12-18 15:10:31 +02:00
Yiorgis Gozadinos
1dbbaf6dd8
vb 2025-12-18 12:21:16 +02:00
Yiorgis Gozadinos
40e0ea090d
Add option to override vacuum interval 2025-12-12 16:04:06 +02:00
Yiorgis Gozadinos
056b9ad090
Use periodic vacuum to prevent disk exhaustion with large datasets 2025-12-12 15:53:23 +02:00
Yiorgis Gozadinos
7526735059
hotpotqa adapter 2025-12-12 10:56:37 +02:00
Yiorgis Gozadinos
f6073a0db9
vb 2025-12-12 10:48:21 +02:00
Yiorgis Gozadinos
00d621e211
vb 2025-12-11 16:31:21 +02:00
Yiorgis Gozadinos
802f058205
Move search related config under SearchConfig 2025-12-09 12:28:28 +02:00
Yiorgis Gozadinos
06b4f6a224
Add format parameter for text-to-DoclingDocument conversion 2025-12-08 15:56:21 +02:00
Yiorgis Gozadinos
9a5f8e4368
Add type-aware context expansion for search results 2025-12-08 15:56:21 +02:00
Yiorgis Gozadinos
dab04668bd
Dependency updates 2025-12-08 15:56:02 +02:00
Yiorgis Gozadinos
a57203065a
Fix test 2025-12-08 15:55:28 +02:00
Yiorgis Gozadinos
d808c6c425
Simplify citations in qa & graph agents 2025-12-08 15:55:27 +02:00
Yiorgis Gozadinos
ace58a7034
Update evaluations and a2a 2025-12-08 15:54:56 +02:00
Yiorgis Gozadinos
fe4ac530be
DB migration 2025-12-08 15:54:56 +02:00
Yiorgis Gozadinos
3525fae625
Use EmbeddingModelConfig similar to ModelConfig for embeddings 2025-12-02 11:55:31 +02:00
Yiorgis Gozadinos
f07590bd5b
vb 2025-12-01 17:58:47 +02:00
Yiorgis Gozadinos
10aa2a7cf2
vb 2025-11-28 10:15:59 +02:00
Yiorgis Gozadinos
eee29578ba
vb 2025-11-27 15:24:39 +02:00
Yiorgis Gozadinos
3959ce39f7
vb 2025-11-27 13:06:04 +02:00
Yiorgis Gozadinos
ca2445d869
vb 2025-11-26 10:33:46 +02:00
Yiorgis Gozadinos
c22a5bb0ce
vb 2025-11-25 13:44:48 +02:00
Yiorgis Gozadinos
8a8005ead0
Add qa/judge models meta to experiment meta 2025-11-25 13:09:29 +02:00
Yiorgis Gozadinos
f843fb8140
Use non-thinking judge in evals 2025-11-25 13:00:25 +02:00
Yiorgis Gozadinos
e83978f88b
Revert embeddings to use flat config 2025-11-25 12:51:58 +02:00
Yiorgis Gozadinos
a9701616c8
Rename model to name under model 2025-11-25 12:28:43 +02:00
Yiorgis Gozadinos
1bb7b6d5bd
Add support for per-model configuration settings including thinking, temperature and max_tokens 2025-11-25 12:14:24 +02:00
Yiorgis Gozadinos
4e1752a740
Default eval db location, evaluation script 2025-11-25 11:07:20 +02:00
Yiorgis Gozadinos
b5892699a0
Use Mean Reciprocal Rank for single document evaluation as metric. Use Mean Average Precision for variable document evaluation as metric 2025-11-24 14:49:30 +02:00
Yiorgis Gozadinos
8d0846b88a
Record useful meta in the experiment 2025-11-24 10:46:25 +02:00
Yiorgis Gozadinos
ada2b66d5b
vb 2025-11-21 16:38:52 +02:00
Yiorgis Gozadinos
63b374c7e9
Name evaluation runs. Use only LLMJudge evaluator. 2025-11-21 13:26:39 +02:00
Yiorgis Gozadinos
09900f8e8b
vb 2025-11-19 13:08:37 +02:00
Yiorgis Gozadinos
0ea5f1e10e
Update dependencies 2025-11-19 10:24:37 +02:00
Yiorgis Gozadinos
826986708d
vb 2025-11-18 15:52:52 +02:00
Yiorgis Gozadinos
efbd5b92f7
vb 2025-11-17 16:30:39 +02:00
Yiorgis Gozadinos
636d5261e6
vb 2025-11-14 22:29:37 +02:00
Yiorgis Gozadinos
adb7d9093d
Run entire evaluation dataset as one so that it appears properly in logfire 2025-11-14 11:39:58 +02:00
Yiorgis Gozadinos
c8999a89b8
Update and lock pydantic-ai-slim 2025-11-14 11:26:09 +02:00
Yiorgis Gozadinos
f55b8c8f19
Load .env in evals 2025-11-14 11:00:58 +02:00
Yiorgis Gozadinos
6eb0d59a28
vb 2025-11-13 15:00:57 +02:00
Yiorgis Gozadinos
34f50f37a0
vb 2025-11-07 14:44:58 +02:00
Yiorgis Gozadinos
0e3f2ebd67
vb 2025-11-06 16:13:53 +02:00