Commit graph

122 commits

Author SHA1 Message Date
Yiorgis Gozadinos
a453853211
Keep using the openai tokenizer 2025-08-01 16:36:24 +02:00
Yiorgis Gozadinos
91f6122ef7
Basic chunking using docling 2025-08-01 16:27:44 +02:00
Yiorgis Gozadinos
f2db1dbe1f
vb 2025-08-01 16:11:37 +02:00
Yiorgis Gozadinos
75c1cdb36c
Merge pull request #26 from ggozad/feat/docling
Use docling for parsing documents
2025-08-01 16:10:34 +02:00
Yiorgis Gozadinos
4bfd54b2ec
Merge pull request #25 from ggozad/feat/sqlite_wal
Use Write-Ahead Logging jorunaling mode for SQLite concurrency
2025-08-01 16:10:13 +02:00
Yiorgis Gozadinos
13c6411d48
Merge pull request #24 from ggozad/feat/version
Add -v --version option to display version
2025-08-01 16:09:58 +02:00
Yiorgis Gozadinos
14d8b18f1d
Wrap code files in md code blocks 2025-08-01 10:13:46 +02:00
Yiorgis Gozadinos
5a08816ed6
Replace markitdown with docling 2025-08-01 09:59:53 +02:00
Yiorgis Gozadinos
0f2809cb8d
Use Write-Ahead Logging jorunaling mode for SQLite concurrency 2025-08-01 09:07:31 +02:00
Yiorgis Gozadinos
8052442052
Add -v --version option to display version 2025-08-01 09:00:20 +02:00
Yiorgis Gozadinos
d677dc8001
vb 2025-07-26 10:45:24 +03:00
Yiorgis Gozadinos
5214432f71
Merge pull request #21 from ggozad/feat/external-chunks
create_document now optionally accepts pre-computed chunks
2025-07-26 10:44:19 +03:00
Yiorgis Gozadinos
74eea9284a
create_document now optionally accepts pre-computed chunks 2025-07-26 10:42:27 +03:00
Yiorgis Gozadinos
62410250e5
vb 2025-07-23 13:53:21 +03:00
Yiorgis Gozadinos
6a7d2ff319
Merge pull request #20 from ggozad/fix/honour-default_data_dir
Honour DEFAULT_DATA_DIR env variable in CLI
2025-07-23 13:52:25 +03:00
Yiorgis Gozadinos
72ce212ad4
Honour DEFAULT_DATA_DIR env variable 2025-07-23 13:49:27 +03:00
Yiorgis Gozadinos
dfe23482da
Tune parameters 2025-07-20 22:45:24 +03:00
Yiorgis Gozadinos
4908ea9fcc
Update benchmarks 2025-07-20 22:45:24 +03:00
Yiorgis Gozadinos
ad9879802a
Fix incorrect syntax for uv pip install with extras 2025-07-20 22:40:12 +03:00
Yiorgis Gozadinos
bb9fd16ca7
vb 2025-07-20 11:41:05 +03:00
Yiorgis Gozadinos
a5eee10e92
Merge pull request #17 from ggozad/feat/reranking
Reranking support with mixedbread + cohere
2025-07-20 11:40:11 +03:00
Yiorgis Gozadinos
942be2271c
Update docs 2025-07-20 11:33:09 +03:00
Yiorgis Gozadinos
c1d5334804
Update benchmarks with reranking 2025-07-19 19:02:47 +03:00
Yiorgis Gozadinos
a6595b1597
Update docs 2025-07-19 13:16:09 +03:00
Yiorgis Gozadinos
2347612fb6
Optionally perform reranking when searching 2025-07-19 13:12:34 +03:00
Yiorgis Gozadinos
1437942edc
Make reranker a global module object to avoid re-initialization 2025-07-19 12:51:22 +03:00
Yiorgis Gozadinos
2343ab7751
Return tuple (Chunk, score,) in rerank() 2025-07-19 12:16:17 +03:00
Yiorgis Gozadinos
f25416b0ff
Properly test cohere reranker 2025-07-18 20:55:28 +03:00
Yiorgis Gozadinos
044e1b0a06
mixedbread reranker as default 2025-07-18 20:29:24 +03:00
Yiorgis Gozadinos
0f8124fd98
Simply embedders 2025-07-17 13:17:47 +03:00
Yiorgis Gozadinos
859860318a
Cohere reranker 2025-07-17 13:17:16 +03:00
Yiorgis Gozadinos
20beb23a38
Fix docstrings 2025-07-16 19:06:54 +03:00
Yiorgis Gozadinos
feff962f2e
Merge pull request #16 from ggozad/feat/db_upgrades
Store haiku.rag version & allow for future db upgrades
2025-07-16 18:46:26 +03:00
Yiorgis Gozadinos
96945e2c98
Merge pull request #15 from ggozad/feat/settings
Store settings to db & check for incompatibilities.
2025-07-16 18:46:07 +03:00
Yiorgis Gozadinos
4d8088efa8
Log db upgrades 2025-07-16 18:32:58 +03:00
Yiorgis Gozadinos
0bf5606117
Store haiku.rag version, enabling upgrades 2025-07-16 18:21:41 +03:00
Yiorgis Gozadinos
f4aef4eb9c
Check pypi version on startup 2025-07-14 12:27:28 +03:00
Yiorgis Gozadinos
a2d7e527d1
Update docs on configuration changes 2025-07-14 12:00:03 +03:00
Yiorgis Gozadinos
a2e0f2cefd
Remove Claude nonsense, use context manager 2025-07-12 23:00:49 +03:00
Yiorgis Gozadinos
62a519b094
Prevent rebuild from throwing and recreate the embeddings table 2025-07-12 21:21:14 +03:00
Yiorgis Gozadinos
4444ec50da
Check if settings are compatible when loading a db 2025-07-12 20:56:49 +03:00
Yiorgis Gozadinos
a59b38158d
Settings table & repo, tests 2025-07-12 20:21:34 +03:00
Yiorgis Gozadinos
eefd51ead6
Update mxbai recall stats 2025-07-09 12:50:39 +03:00
Yiorgis Gozadinos
556a5d2b58
vb 2025-07-09 10:49:41 +03:00
Yiorgis Gozadinos
60b072a1ee
Merge pull request #14 from ggozad/feat/better-qa
Improve QA agent with multiple tool calls, provide performance benchmarks
2025-07-09 10:46:28 +03:00
Yiorgis Gozadinos
42e62f92a1
Better formatting of benchmark script 2025-07-09 10:27:32 +03:00
Yiorgis Gozadinos
9d72a158a6
Document benchmarks 2025-07-08 19:01:54 +03:00
Yiorgis Gozadinos
2f261a33f5
Allow multiple tool calling rounds in QA agent 2025-07-08 12:51:58 +03:00
Yiorgis Gozadinos
bea96f1b1b
Better prompts 2025-07-04 13:29:51 +03:00
Yiorgis Gozadinos
dd39cf5927
vb 2025-07-04 12:15:31 +03:00