Yiorgis Gozadinos
|
43b9cd50ba
|
Move evaluations to src/
|
2025-09-30 13:21:53 +03:00 |
|
Yiorgis Gozadinos
|
6bcc251e5d
|
Merge pull request #88 from ggozad/fix/clarify-incompatible-settings
Make exception for incompatible settings more user-friendly
|
2025-09-30 12:22:37 +03:00 |
|
Yiorgis Gozadinos
|
9318ffc302
|
Make exception for incompatible settings more user-friendly
|
2025-09-30 12:19:08 +03:00 |
|
Yiorgis Gozadinos
|
6a1d7b3fa9
|
Ignore tests/data where we store the qa corpus
|
2025-09-30 11:42:28 +03:00 |
|
Yiorgis Gozadinos
|
2ae11200b4
|
Merge pull request #87 from ggozad/feat/multiple-eval-datasets
Run evaluations with alternate datasets. Use WixQA as an example.
|
2025-09-30 11:32:40 +03:00 |
|
Yiorgis Gozadinos
|
06dbdbd474
|
Update docs for wix benchmarks
|
2025-09-30 11:31:52 +03:00 |
|
Yiorgis Gozadinos
|
abfc796c42
|
Use gpt-oss for evaluation LLMJudge, allow it to retry if it fails
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
f62d3e552b
|
Exclude evaluations, test, docs, github actions from builds
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
6f20d9fd6d
|
Update recall of qwen3 embeddings with mxbai reranking
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
9a859c6ee5
|
Add option to skip db in evals
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
842e166041
|
Adapt how we measure recall when using datasets with multiple sources
|
2025-09-30 11:31:51 +03:00 |
|
Yiorgis Gozadinos
|
eb2fc67e1c
|
When populating the eval db, check if chunks for the document have been created. Protects against interrupts
|
2025-09-30 11:31:50 +03:00 |
|
Yiorgis Gozadinos
|
55dc4bbdd2
|
Return an empty array when request en empty embedding
|
2025-09-30 11:31:50 +03:00 |
|
Yiorgis Gozadinos
|
57e86d00fd
|
Refactor evaluations so that we can perform with multiple datasets..
Introduce Wix dataset.
|
2025-09-30 11:31:50 +03:00 |
|
Yiorgis Gozadinos
|
73209b203c
|
Merge pull request #86 from ggozad/feat/pydantic-evaluations
Use pydantic evals for running our own evaluations
|
2025-09-30 11:31:20 +03:00 |
|
Yiorgis Gozadinos
|
19ad1b9d7d
|
improve output
|
2025-09-30 11:30:35 +03:00 |
|
Yiorgis Gozadinos
|
87f28ed96b
|
Update docs
|
2025-09-30 11:30:35 +03:00 |
|
Yiorgis Gozadinos
|
7cc4e13b57
|
Make benchmarks use pydantic evals
|
2025-09-30 11:30:34 +03:00 |
|
Yiorgis Gozadinos
|
53557b0629
|
Merge pull request #85 from ggozad/chore/qwen3-embeddings
Change default embedding to qwen3-embedding. Update benchmarks.
|
2025-09-30 11:30:02 +03:00 |
|
Yiorgis Gozadinos
|
14168db795
|
Fix embedding client test
|
2025-09-26 13:52:06 +03:00 |
|
Yiorgis Gozadinos
|
f0333e33ac
|
Change default embedding to qwen3-embedding. Update benchmarks using qwen3-embedding and gpt-oss
|
2025-09-26 13:23:38 +03:00 |
|
Yiorgis Gozadinos
|
cb93f0913a
|
vb
|
2025-09-25 10:57:19 +03:00 |
|
Yiorgis Gozadinos
|
1135d52223
|
Merge pull request #84 from ggozad/fix/no-upgrades-new-db
Do not run db upgrades when creating a new db
|
2025-09-25 10:55:07 +03:00 |
|
Yiorgis Gozadinos
|
184fd12e42
|
Do not run db upgrades when creating a new db
|
2025-09-25 10:52:11 +03:00 |
|
Yiorgis Gozadinos
|
039daa949a
|
Merge pull request #82 from ggozad/fix/asciidoc
Fix asciidoc extensions in FileParser
|
2025-09-25 10:11:00 +03:00 |
|
Yiorgis Gozadinos
|
256093d868
|
AsciiDoc uses .adoc, not just .asciidoc extensions
|
2025-09-25 10:09:21 +03:00 |
|
Yiorgis Gozadinos
|
9a249db836
|
vb
|
2025-09-24 16:50:01 +03:00 |
|
Yiorgis Gozadinos
|
a2e2d616c3
|
Merge pull request #77 from ggozad/feat/research-improvements
Research improvements, improves speed & quality
|
2025-09-24 16:40:54 +03:00 |
|
Yiorgis Gozadinos
|
064b823020
|
Break Evaluation node into AnalyzeInsights & DecisionNode. Use a list of updateable insights & gaps
|
2025-09-24 16:26:48 +03:00 |
|
Yiorgis Gozadinos
|
5caca8229f
|
Merge pull request #76 from ggozad/feat/streaming-research
Streaming support for research
|
2025-09-24 16:25:09 +03:00 |
|
Yiorgis Gozadinos
|
84e94f8257
|
Wire gaps that were forgotten
|
2025-09-24 14:03:53 +03:00 |
|
Yiorgis Gozadinos
|
57bac178dd
|
Update docs
|
2025-09-24 13:43:49 +03:00 |
|
Yiorgis Gozadinos
|
cf9d6a116f
|
Do not duplicate ResearchContext in ResearchState
|
2025-09-24 13:43:07 +03:00 |
|
Yiorgis Gozadinos
|
086eb56d34
|
Stream research
|
2025-09-24 11:27:05 +03:00 |
|
Yiorgis Gozadinos
|
9769061f54
|
vb
|
2025-09-23 16:49:40 +03:00 |
|
Yiorgis Gozadinos
|
14bbcd13c8
|
Merge pull request #74 from ggozad/feat/meta-add
Add --meta option to add-src & add CLI commands
|
2025-09-23 16:48:09 +03:00 |
|
Yiorgis Gozadinos
|
8f3055d37d
|
Parse non-strings
|
2025-09-23 16:42:40 +03:00 |
|
Yiorgis Gozadinos
|
45d0b47a02
|
Meta in CLI add-src, add
|
2025-09-23 16:39:27 +03:00 |
|
Yiorgis Gozadinos
|
860c3acbfc
|
Merge pull request #73 from ggozad/feat/prefetch-models
CLI command to prefetch models (Ollama & Docling)
|
2025-09-23 16:31:21 +03:00 |
|
Yiorgis Gozadinos
|
0e1bf3e00d
|
CLI command to prefetch models (Ollama & Docling)
|
2025-09-23 16:30:56 +03:00 |
|
Yiorgis Gozadinos
|
13b3ab3cf7
|
Merge pull request #72 from ggozad/feat/info-command
info CLI command, displays basic info about a db
|
2025-09-23 12:44:50 +03:00 |
|
Yiorgis Gozadinos
|
5369bd5dda
|
Show db table versions
|
2025-09-23 12:44:05 +03:00 |
|
Yiorgis Gozadinos
|
c0de22c9cd
|
Show package versions
|
2025-09-23 12:34:32 +03:00 |
|
Yiorgis Gozadinos
|
5ea5de274c
|
Make styles consistent
|
2025-09-23 12:27:01 +03:00 |
|
Yiorgis Gozadinos
|
52ea1ebb70
|
info command in CLI
|
2025-09-23 12:20:25 +03:00 |
|
Yiorgis Gozadinos
|
b46765e197
|
vb
|
2025-09-22 13:59:03 +03:00 |
|
Yiorgis Gozadinos
|
a1cd64de2f
|
Merge pull request #69 from ggozad/feat/display-title
Add optional "title" to Documents. Replaces "uri" where appropriate.
|
2025-09-22 13:53:20 +03:00 |
|
Yiorgis Gozadinos
|
2c93f4f823
|
Preserve title if it exists when expanding context
|
2025-09-22 13:45:59 +03:00 |
|
Yiorgis Gozadinos
|
20993b48a7
|
Fix test after rebase
|
2025-09-22 12:53:52 +03:00 |
|
Yiorgis Gozadinos
|
8e2829bf0e
|
Documentation update for title
|
2025-09-22 12:45:32 +03:00 |
|