Yiorgis Gozadinos
|
fd327996b8
|
Configurable judge and reflect models for evaluations
|
2026-03-18 17:14:11 +02:00 |
|
Yiorgis Gozadinos
|
9243f56e1c
|
vb
|
2026-03-16 14:30:08 +02:00 |
|
Yiorgis Gozadinos
|
f961f00f2c
|
vb
|
2026-03-13 13:24:31 +02:00 |
|
Yiorgis Gozadinos
|
a0025e9203
|
Fix ty
|
2026-03-13 12:51:35 +02:00 |
|
Yiorgis Gozadinos
|
7696b3f98f
|
vb
|
2026-03-12 14:46:13 +02:00 |
|
Yiorgis Gozadinos
|
6ac5f277d8
|
Rename iterations to num_candidates
|
2026-03-12 13:00:51 +02:00 |
|
Yiorgis Gozadinos
|
5b3ad9bae7
|
Refactor QAPromptAdapter to accept QA agent directly, rewrite mock-heavy tests
|
2026-03-12 12:35:39 +02:00 |
|
Yiorgis Gozadinos
|
24275d2ef9
|
Fixes
|
2026-03-12 12:19:21 +02:00 |
|
Yiorgis Gozadinos
|
c785a54f5f
|
Respect config.prompts.qa in evaluations benchmark and optimization
|
2026-03-12 12:05:51 +02:00 |
|
Yiorgis Gozadinos
|
6812435ba0
|
cleanup
|
2026-03-12 12:05:50 +02:00 |
|
Yiorgis Gozadinos
|
7c399d1ff1
|
Remove evaluation ceremony from gepa judge
|
2026-03-12 12:05:50 +02:00 |
|
Yiorgis Gozadinos
|
8bac8b4104
|
Properly choose training/eval set
|
2026-03-12 12:05:50 +02:00 |
|
Yiorgis Gozadinos
|
66f88f7872
|
Test evaluations
|
2026-03-12 12:05:50 +02:00 |
|
Yiorgis Gozadinos
|
45f7ac8d1b
|
run_optimization should be sync
|
2026-03-12 12:05:25 +02:00 |
|
Yiorgis Gozadinos
|
adc83e5f81
|
Tests for gepa
|
2026-03-12 12:05:25 +02:00 |
|
Yiorgis Gozadinos
|
60b1d3c013
|
Add GEPA prompt optimization for QA evaluations
|
2026-03-12 12:05:25 +02:00 |
|
Yiorgis Gozadinos
|
8d6617d63f
|
vb
|
2026-03-11 17:08:22 +02:00 |
|
Yiorgis Gozadinos
|
e2749ad2a6
|
Cap QA agent search iterations to reduce response time
|
2026-03-11 12:13:43 +02:00 |
|
Yiorgis Gozadinos
|
f366aea905
|
vb
|
2026-03-06 11:12:54 +02:00 |
|
Yiorgis Gozadinos
|
40ff54eac0
|
Set params for evaluations judge
|
2026-03-05 13:59:20 +02:00 |
|
Yiorgis Gozadinos
|
30ebd6694b
|
Update dependencies
|
2026-03-05 13:01:53 +02:00 |
|
Yiorgis Gozadinos
|
878423ea2e
|
vb
|
2026-03-04 15:02:34 +02:00 |
|
Yiorgis Gozadinos
|
8a859fbe3c
|
vb
|
2026-03-03 17:25:53 +02:00 |
|
Yiorgis Gozadinos
|
99ca3605e7
|
vb
|
2026-02-28 14:11:25 +02:00 |
|
Yiorgis Gozadinos
|
50116bb49a
|
vb
|
2026-02-26 11:21:46 +02:00 |
|
Yiorgis Gozadinos
|
2acb0292e4
|
vb
|
2026-02-24 13:30:01 +02:00 |
|
Yiorgis Gozadinos
|
2cafb5c8cc
|
vb
|
2026-02-20 19:41:17 +02:00 |
|
Yiorgis Gozadinos
|
e186e13cd2
|
vb
|
2026-02-20 19:01:16 +02:00 |
|
Yiorgis Gozadinos
|
4855051936
|
Add research() to client and add haiku.skills dependency, remove --deep flag and simplify app
|
2026-02-20 16:36:47 +02:00 |
|
Yiorgis Gozadinos
|
0c270ba42f
|
vb
|
2026-02-19 14:28:13 +02:00 |
|
Yiorgis Gozadinos
|
c62fe5fce8
|
vb
|
2026-02-17 13:56:43 +02:00 |
|
Yiorgis Gozadinos
|
2d5fbd06f2
|
Update dependencies
|
2026-02-17 13:12:08 +02:00 |
|
Yiorgis Gozadinos
|
53f6cd3579
|
vb
|
2026-02-16 13:12:06 +02:00 |
|
Yiorgis Gozadinos
|
aaa9b6a32f
|
vb
|
2026-02-10 13:29:30 +02:00 |
|
Yiorgis Gozadinos
|
17c2136b4e
|
vb
|
2026-02-06 12:48:16 +01:00 |
|
Yiorgis Gozadinos
|
1e22937482
|
vb
|
2026-01-31 11:12:38 +02:00 |
|
Yiorgis Gozadinos
|
42f2d0fd0e
|
docs
|
2026-01-31 10:13:22 +02:00 |
|
Yiorgis Gozadinos
|
4264cdcc24
|
vb
|
2026-01-29 15:35:42 +02:00 |
|
Yiorgis Gozadinos
|
2a99cb09bf
|
Evaluate using ask --deep
|
2026-01-29 14:22:18 +02:00 |
|
Yiorgis Gozadinos
|
39f4937916
|
Handle missing datasets from huggingface
|
2026-01-29 13:31:31 +02:00 |
|
Yiorgis Gozadinos
|
bb634e68a4
|
vb
|
2026-01-27 11:17:17 +02:00 |
|
Yiorgis Gozadinos
|
7c9d70fa62
|
vb
|
2026-01-26 16:46:33 +02:00 |
|
Yiorgis Gozadinos
|
369b3a4bf7
|
No zip
|
2026-01-26 16:28:19 +02:00 |
|
Yiorgis Gozadinos
|
9b166969e2
|
Introduce huggingface dataset for sharing evaluation dbs
|
2026-01-26 15:53:37 +02:00 |
|
Yiorgis Gozadinos
|
c7a9ad8583
|
Customize orb QA prompt to not use LaTeX as gpt-oss Ollama implementation fails to parse it properly
|
2026-01-24 13:48:09 +02:00 |
|
Yiorgis Gozadinos
|
47d355ed0a
|
Update dependencies
|
2026-01-23 11:57:02 +02:00 |
|
Yiorgis Gozadinos
|
35ebdd67e2
|
vb
|
2026-01-22 17:48:39 +02:00 |
|
Yiorgis Gozadinos
|
0d3ac5142d
|
Fix answer in orb
|
2026-01-22 15:08:33 +02:00 |
|
Yiorgis Gozadinos
|
de022639b6
|
Correctly lookup docs for the orb dataset
|
2026-01-22 14:17:09 +02:00 |
|
Yiorgis Gozadinos
|
e6b239bd6c
|
Add evaluation dataset for multi-modal q&a
|
2026-01-22 14:17:09 +02:00 |
|