Commit graph

131 commits

Author SHA1 Message Date
Yiorgis Gozadinos
8a5188aa01
vb 2026-03-24 14:23:29 +02:00
Yiorgis Gozadinos
83ea6347b6
Fix CI failures: update tests for pydantic-ai 1.70.0 and FastMCP API changes 2026-03-24 14:02:03 +02:00
Yiorgis Gozadinos
fd327996b8
Configurable judge and reflect models for evaluations 2026-03-18 17:14:11 +02:00
Yiorgis Gozadinos
9243f56e1c
vb 2026-03-16 14:30:08 +02:00
Yiorgis Gozadinos
f961f00f2c
vb 2026-03-13 13:24:31 +02:00
Yiorgis Gozadinos
a0025e9203
Fix ty 2026-03-13 12:51:35 +02:00
Yiorgis Gozadinos
7696b3f98f
vb 2026-03-12 14:46:13 +02:00
Yiorgis Gozadinos
6ac5f277d8
Rename iterations to num_candidates 2026-03-12 13:00:51 +02:00
Yiorgis Gozadinos
5b3ad9bae7
Refactor QAPromptAdapter to accept QA agent directly, rewrite mock-heavy tests 2026-03-12 12:35:39 +02:00
Yiorgis Gozadinos
24275d2ef9
Fixes 2026-03-12 12:19:21 +02:00
Yiorgis Gozadinos
c785a54f5f
Respect config.prompts.qa in evaluations benchmark and optimization 2026-03-12 12:05:51 +02:00
Yiorgis Gozadinos
6812435ba0
cleanup 2026-03-12 12:05:50 +02:00
Yiorgis Gozadinos
7c399d1ff1
Remove evaluation ceremony from gepa judge 2026-03-12 12:05:50 +02:00
Yiorgis Gozadinos
8bac8b4104
Properly choose training/eval set 2026-03-12 12:05:50 +02:00
Yiorgis Gozadinos
66f88f7872
Test evaluations 2026-03-12 12:05:50 +02:00
Yiorgis Gozadinos
45f7ac8d1b
run_optimization should be sync 2026-03-12 12:05:25 +02:00
Yiorgis Gozadinos
adc83e5f81
Tests for gepa 2026-03-12 12:05:25 +02:00
Yiorgis Gozadinos
60b1d3c013
Add GEPA prompt optimization for QA evaluations 2026-03-12 12:05:25 +02:00
Yiorgis Gozadinos
8d6617d63f
vb 2026-03-11 17:08:22 +02:00
Yiorgis Gozadinos
e2749ad2a6
Cap QA agent search iterations to reduce response time 2026-03-11 12:13:43 +02:00
Yiorgis Gozadinos
f366aea905
vb 2026-03-06 11:12:54 +02:00
Yiorgis Gozadinos
40ff54eac0
Set params for evaluations judge 2026-03-05 13:59:20 +02:00
Yiorgis Gozadinos
30ebd6694b
Update dependencies 2026-03-05 13:01:53 +02:00
Yiorgis Gozadinos
878423ea2e
vb 2026-03-04 15:02:34 +02:00
Yiorgis Gozadinos
8a859fbe3c
vb 2026-03-03 17:25:53 +02:00
Yiorgis Gozadinos
99ca3605e7
vb 2026-02-28 14:11:25 +02:00
Yiorgis Gozadinos
50116bb49a
vb 2026-02-26 11:21:46 +02:00
Yiorgis Gozadinos
2acb0292e4
vb 2026-02-24 13:30:01 +02:00
Yiorgis Gozadinos
2cafb5c8cc
vb 2026-02-20 19:41:17 +02:00
Yiorgis Gozadinos
e186e13cd2
vb 2026-02-20 19:01:16 +02:00
Yiorgis Gozadinos
4855051936
Add research() to client and add haiku.skills dependency, remove --deep flag and simplify app 2026-02-20 16:36:47 +02:00
Yiorgis Gozadinos
0c270ba42f
vb 2026-02-19 14:28:13 +02:00
Yiorgis Gozadinos
c62fe5fce8
vb 2026-02-17 13:56:43 +02:00
Yiorgis Gozadinos
2d5fbd06f2
Update dependencies 2026-02-17 13:12:08 +02:00
Yiorgis Gozadinos
53f6cd3579
vb 2026-02-16 13:12:06 +02:00
Yiorgis Gozadinos
aaa9b6a32f
vb 2026-02-10 13:29:30 +02:00
Yiorgis Gozadinos
17c2136b4e
vb 2026-02-06 12:48:16 +01:00
Yiorgis Gozadinos
1e22937482
vb 2026-01-31 11:12:38 +02:00
Yiorgis Gozadinos
42f2d0fd0e
docs 2026-01-31 10:13:22 +02:00
Yiorgis Gozadinos
4264cdcc24
vb 2026-01-29 15:35:42 +02:00
Yiorgis Gozadinos
2a99cb09bf
Evaluate using ask --deep 2026-01-29 14:22:18 +02:00
Yiorgis Gozadinos
39f4937916
Handle missing datasets from huggingface 2026-01-29 13:31:31 +02:00
Yiorgis Gozadinos
bb634e68a4
vb 2026-01-27 11:17:17 +02:00
Yiorgis Gozadinos
7c9d70fa62
vb 2026-01-26 16:46:33 +02:00
Yiorgis Gozadinos
369b3a4bf7
No zip 2026-01-26 16:28:19 +02:00
Yiorgis Gozadinos
9b166969e2
Introduce huggingface dataset for sharing evaluation dbs 2026-01-26 15:53:37 +02:00
Yiorgis Gozadinos
c7a9ad8583
Customize orb QA prompt to not use LaTeX as gpt-oss Ollama implementation fails to parse it properly 2026-01-24 13:48:09 +02:00
Yiorgis Gozadinos
47d355ed0a
Update dependencies 2026-01-23 11:57:02 +02:00
Yiorgis Gozadinos
35ebdd67e2
vb 2026-01-22 17:48:39 +02:00
Yiorgis Gozadinos
0d3ac5142d
Fix answer in orb 2026-01-22 15:08:33 +02:00