Commit graph

15 commits

Author SHA1 Message Date
Yiorgis Gozadinos
a9701616c8
Rename model to name under model 2025-11-25 12:28:43 +02:00
Yiorgis Gozadinos
1bb7b6d5bd
Add support for per-model configuration settings including thinking, temperature and max_tokens 2025-11-25 12:14:24 +02:00
Yiorgis Gozadinos
b5892699a0
Use Mean Reciprocal Rank for single document evaluation as metric. Use Mean Average Precision for variable document evaluation as metric 2025-11-24 14:49:30 +02:00
Yiorgis Gozadinos
b8bc6d9b68
Let ruff know about our package structure 2025-11-05 17:47:27 +02:00
Yiorgis Gozadinos
469d993542
Remove provider API keys from config, rely on environment variables for those 2025-10-23 13:52:57 +03:00
Yiorgis Gozadinos
618b3ffd5f
Refactor config from flat to nested Pydantic models 2025-10-23 13:30:21 +03:00
Yiorgis Gozadinos
57e86d00fd
Refactor evaluations so that we can perform with multiple datasets..
Introduce Wix dataset.
2025-09-30 11:31:50 +03:00
Yiorgis Gozadinos
bc28e60cf7
Support vLLM for QA agents 2025-09-04 15:20:37 +03:00
Yiorgis Gozadinos
b83596ff07
Basic moving to lancedb. 2025-09-01 14:56:14 +03:00
Yiorgis Gozadinos
1f61d78165
Bring back QA_MODEL and keep compatibility with previous versions 2025-08-17 15:27:03 +02:00
Yiorgis Gozadinos
d6d79d5e94
Allow any provider/model supported by pydantic AI 2025-08-17 14:55:50 +02:00
Yiorgis Gozadinos
390397570a
Migrate QA agent to Pydantic AI. 2025-08-15 21:13:17 +02:00
Yiorgis Gozadinos
e66c160055
Support for anthropic in Question/Answering 2025-07-04 11:55:03 +03:00
Yiorgis Gozadinos
85b106c461
OpenAI Question/Answer agent 2025-06-28 09:11:39 +03:00
Yiorgis Gozadinos
2855dd7c13
Use LLM-as-a-judge to test QA 2025-06-25 18:18:28 +03:00