Yiorgis Gozadinos
|
6f181e07ff
|
Add Success@K metrics to retrieval benchmarks
|
2025-10-06 14:54:17 +03:00 |
|
Yiorgis Gozadinos
|
cf2af489b5
|
Allow QA agent to retry
|
2025-10-06 11:21:42 +03:00 |
|
Yiorgis Gozadinos
|
99463cc39b
|
vb
|
2025-10-01 08:41:51 +03:00 |
|
Yiorgis Gozadinos
|
39f804e035
|
Merge pull request #89 from ggozad/feat/deep-qa
Deep Question/Answer graph agent.
|
2025-10-01 08:41:07 +03:00 |
|
Yiorgis Gozadinos
|
a6275fcf25
|
Rename nodes to make it clear they are part of Q/A
|
2025-09-30 16:59:36 +03:00 |
|
Yiorgis Gozadinos
|
49eac86259
|
Add verbose flag to ask
|
2025-09-30 16:59:36 +03:00 |
|
Yiorgis Gozadinos
|
2dfb1882dd
|
Deep QA multi-agent
|
2025-09-30 16:59:36 +03:00 |
|
Yiorgis Gozadinos
|
42c54a8d25
|
Shuffle reusable nodes under graph/
|
2025-09-30 16:59:36 +03:00 |
|
Yiorgis Gozadinos
|
fa698cca28
|
vb
|
2025-09-30 16:58:52 +03:00 |
|
Yiorgis Gozadinos
|
999f9408f6
|
Merge pull request #90 from ggozad/fix/rebuild-missing-docs
Fix rebuilding for missing documents by re-embedding.
|
2025-09-30 16:57:58 +03:00 |
|
Yiorgis Gozadinos
|
05c382fcb5
|
When rebuilding if a document does not exist anymore, re-embed the chunks instead of failing
|
2025-09-30 16:57:02 +03:00 |
|
Yiorgis Gozadinos
|
43b9cd50ba
|
Move evaluations to src/
|
2025-09-30 13:21:53 +03:00 |
|
Yiorgis Gozadinos
|
6bcc251e5d
|
Merge pull request #88 from ggozad/fix/clarify-incompatible-settings
Make exception for incompatible settings more user-friendly
|
2025-09-30 12:22:37 +03:00 |
|
Yiorgis Gozadinos
|
9318ffc302
|
Make exception for incompatible settings more user-friendly
|
2025-09-30 12:19:08 +03:00 |
|
Yiorgis Gozadinos
|
6a1d7b3fa9
|
Ignore tests/data where we store the qa corpus
|
2025-09-30 11:42:28 +03:00 |
|
Yiorgis Gozadinos
|
2ae11200b4
|
Merge pull request #87 from ggozad/feat/multiple-eval-datasets
Run evaluations with alternate datasets. Use WixQA as an example.
|
2025-09-30 11:32:40 +03:00 |
|
Yiorgis Gozadinos
|
06dbdbd474
|
Update docs for wix benchmarks
|
2025-09-30 11:31:52 +03:00 |
|
Yiorgis Gozadinos
|
abfc796c42
|
Use gpt-oss for evaluation LLMJudge, allow it to retry if it fails
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
f62d3e552b
|
Exclude evaluations, test, docs, github actions from builds
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
6f20d9fd6d
|
Update recall of qwen3 embeddings with mxbai reranking
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
9a859c6ee5
|
Add option to skip db in evals
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
842e166041
|
Adapt how we measure recall when using datasets with multiple sources
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
eb2fc67e1c
|
When populating the eval db, check if chunks for the document have been created. Protects against interrupts
|
2025-09-30 11:31:50 +03:00 |
|
Yiorgis Gozadinos
|
55dc4bbdd2
|
Return an empty array when request en empty embedding
|
2025-09-30 11:31:50 +03:00 |
|
Yiorgis Gozadinos
|
57e86d00fd
|
Refactor evaluations so that we can perform with multiple datasets..
Introduce Wix dataset.
|
2025-09-30 11:31:50 +03:00 |
|
Yiorgis Gozadinos
|
73209b203c
|
Merge pull request #86 from ggozad/feat/pydantic-evaluations
Use pydantic evals for running our own evaluations
|
2025-09-30 11:31:20 +03:00 |
|
Yiorgis Gozadinos
|
19ad1b9d7d
|
improve output
|
2025-09-30 11:30:35 +03:00 |
|
Yiorgis Gozadinos
|
87f28ed96b
|
Update docs
|
2025-09-30 11:30:35 +03:00 |
|
Yiorgis Gozadinos
|
7cc4e13b57
|
Make benchmarks use pydantic evals
|
2025-09-30 11:30:34 +03:00 |
|
Yiorgis Gozadinos
|
53557b0629
|
Merge pull request #85 from ggozad/chore/qwen3-embeddings
Change default embedding to qwen3-embedding. Update benchmarks.
|
2025-09-30 11:30:02 +03:00 |
|
Yiorgis Gozadinos
|
14168db795
|
Fix embedding client test
|
2025-09-26 13:52:06 +03:00 |
|
Yiorgis Gozadinos
|
f0333e33ac
|
Change default embedding to qwen3-embedding. Update benchmarks using qwen3-embedding and gpt-oss
|
2025-09-26 13:23:38 +03:00 |
|
Yiorgis Gozadinos
|
cb93f0913a
|
vb
|
2025-09-25 10:57:19 +03:00 |
|
Yiorgis Gozadinos
|
1135d52223
|
Merge pull request #84 from ggozad/fix/no-upgrades-new-db
Do not run db upgrades when creating a new db
|
2025-09-25 10:55:07 +03:00 |
|
Yiorgis Gozadinos
|
184fd12e42
|
Do not run db upgrades when creating a new db
|
2025-09-25 10:52:11 +03:00 |
|
Yiorgis Gozadinos
|
039daa949a
|
Merge pull request #82 from ggozad/fix/asciidoc
Fix asciidoc extensions in FileParser
|
2025-09-25 10:11:00 +03:00 |
|
Yiorgis Gozadinos
|
256093d868
|
AsciiDoc uses .adoc, not just .asciidoc extensions
|
2025-09-25 10:09:21 +03:00 |
|
Yiorgis Gozadinos
|
9a249db836
|
vb
|
2025-09-24 16:50:01 +03:00 |
|
Yiorgis Gozadinos
|
a2e2d616c3
|
Merge pull request #77 from ggozad/feat/research-improvements
Research improvements, improves speed & quality
|
2025-09-24 16:40:54 +03:00 |
|
Yiorgis Gozadinos
|
064b823020
|
Break Evaluation node into AnalyzeInsights & DecisionNode. Use a list of updateable insights & gaps
|
2025-09-24 16:26:48 +03:00 |
|
Yiorgis Gozadinos
|
5caca8229f
|
Merge pull request #76 from ggozad/feat/streaming-research
Streaming support for research
|
2025-09-24 16:25:09 +03:00 |
|
Yiorgis Gozadinos
|
84e94f8257
|
Wire gaps that were forgotten
|
2025-09-24 14:03:53 +03:00 |
|
Yiorgis Gozadinos
|
57bac178dd
|
Update docs
|
2025-09-24 13:43:49 +03:00 |
|
Yiorgis Gozadinos
|
cf9d6a116f
|
Do not duplicate ResearchContext in ResearchState
|
2025-09-24 13:43:07 +03:00 |
|
Yiorgis Gozadinos
|
086eb56d34
|
Stream research
|
2025-09-24 11:27:05 +03:00 |
|
Yiorgis Gozadinos
|
9769061f54
|
vb
|
2025-09-23 16:49:40 +03:00 |
|
Yiorgis Gozadinos
|
14bbcd13c8
|
Merge pull request #74 from ggozad/feat/meta-add
Add --meta option to add-src & add CLI commands
|
2025-09-23 16:48:09 +03:00 |
|
Yiorgis Gozadinos
|
8f3055d37d
|
Parse non-strings
|
2025-09-23 16:42:40 +03:00 |
|
Yiorgis Gozadinos
|
45d0b47a02
|
Meta in CLI add-src, add
|
2025-09-23 16:39:27 +03:00 |
|
Yiorgis Gozadinos
|
860c3acbfc
|
Merge pull request #73 from ggozad/feat/prefetch-models
CLI command to prefetch models (Ollama & Docling)
|
2025-09-23 16:31:21 +03:00 |
|