Commit graph

82 commits

Author SHA1 Message Date
Yiorgis Gozadinos
8d98eed2e2
Make mxbai reranker optional. Only use a reranker if mxbai or cohere are installed 2025-08-10 19:49:14 +02:00
Yiorgis Gozadinos
0b3477c46c
Rebuild now re-adds files. 2025-08-08 18:30:53 +02:00
Yiorgis Gozadinos
22ed9ca51e
Disable python warning unless in development 2025-08-08 17:31:42 +02:00
Yiorgis Gozadinos
ad4b655a31
Operate on DoclingDocument instead of Document 2025-08-08 17:24:34 +02:00
Yiorgis Gozadinos
6a3c85e6ae
text_to_docling_document() util 2025-08-08 15:38:57 +02:00
Yiorgis Gozadinos
b92f25d6fb
Make FileReader return a DoclingDocument instead of a md string 2025-08-08 14:45:24 +02:00
Yiorgis Gozadinos
7906b1b026
Use absolute paths when add-src 2025-08-08 14:34:13 +02:00
Yiorgis Gozadinos
af95b5f3eb
Replace loop.run_until_complete() with asyncio.run() 2025-08-08 12:41:50 +02:00
Yiorgis Gozadinos
9b4942401f
Fix file extension typo 2025-08-01 17:15:14 +02:00
Yiorgis Gozadinos
ec1bc21a91
Contextualize chunks 2025-08-01 16:54:51 +02:00
Yiorgis Gozadinos
a453853211
Keep using the openai tokenizer 2025-08-01 16:36:24 +02:00
Yiorgis Gozadinos
91f6122ef7
Basic chunking using docling 2025-08-01 16:27:44 +02:00
Yiorgis Gozadinos
75c1cdb36c
Merge pull request #26 from ggozad/feat/docling
Use docling for parsing documents
2025-08-01 16:10:34 +02:00
Yiorgis Gozadinos
4bfd54b2ec
Merge pull request #25 from ggozad/feat/sqlite_wal
Use Write-Ahead Logging jorunaling mode for SQLite concurrency
2025-08-01 16:10:13 +02:00
Yiorgis Gozadinos
14d8b18f1d
Wrap code files in md code blocks 2025-08-01 10:13:46 +02:00
Yiorgis Gozadinos
5a08816ed6
Replace markitdown with docling 2025-08-01 09:59:53 +02:00
Yiorgis Gozadinos
0f2809cb8d
Use Write-Ahead Logging jorunaling mode for SQLite concurrency 2025-08-01 09:07:31 +02:00
Yiorgis Gozadinos
8052442052
Add -v --version option to display version 2025-08-01 09:00:20 +02:00
Yiorgis Gozadinos
74eea9284a
create_document now optionally accepts pre-computed chunks 2025-07-26 10:42:27 +03:00
Yiorgis Gozadinos
6a7d2ff319
Merge pull request #20 from ggozad/fix/honour-default_data_dir
Honour DEFAULT_DATA_DIR env variable in CLI
2025-07-23 13:52:25 +03:00
Yiorgis Gozadinos
72ce212ad4
Honour DEFAULT_DATA_DIR env variable 2025-07-23 13:49:27 +03:00
Yiorgis Gozadinos
dfe23482da
Tune parameters 2025-07-20 22:45:24 +03:00
Yiorgis Gozadinos
ad9879802a
Fix incorrect syntax for uv pip install with extras 2025-07-20 22:40:12 +03:00
Yiorgis Gozadinos
942be2271c
Update docs 2025-07-20 11:33:09 +03:00
Yiorgis Gozadinos
c1d5334804
Update benchmarks with reranking 2025-07-19 19:02:47 +03:00
Yiorgis Gozadinos
2347612fb6
Optionally perform reranking when searching 2025-07-19 13:12:34 +03:00
Yiorgis Gozadinos
1437942edc
Make reranker a global module object to avoid re-initialization 2025-07-19 12:51:22 +03:00
Yiorgis Gozadinos
2343ab7751
Return tuple (Chunk, score,) in rerank() 2025-07-19 12:16:17 +03:00
Yiorgis Gozadinos
f25416b0ff
Properly test cohere reranker 2025-07-18 20:55:28 +03:00
Yiorgis Gozadinos
044e1b0a06
mixedbread reranker as default 2025-07-18 20:29:24 +03:00
Yiorgis Gozadinos
0f8124fd98
Simply embedders 2025-07-17 13:17:47 +03:00
Yiorgis Gozadinos
859860318a
Cohere reranker 2025-07-17 13:17:16 +03:00
Yiorgis Gozadinos
20beb23a38
Fix docstrings 2025-07-16 19:06:54 +03:00
Yiorgis Gozadinos
4d8088efa8
Log db upgrades 2025-07-16 18:32:58 +03:00
Yiorgis Gozadinos
0bf5606117
Store haiku.rag version, enabling upgrades 2025-07-16 18:21:41 +03:00
Yiorgis Gozadinos
f4aef4eb9c
Check pypi version on startup 2025-07-14 12:27:28 +03:00
Yiorgis Gozadinos
a2e0f2cefd
Remove Claude nonsense, use context manager 2025-07-12 23:00:49 +03:00
Yiorgis Gozadinos
62a519b094
Prevent rebuild from throwing and recreate the embeddings table 2025-07-12 21:21:14 +03:00
Yiorgis Gozadinos
4444ec50da
Check if settings are compatible when loading a db 2025-07-12 20:56:49 +03:00
Yiorgis Gozadinos
a59b38158d
Settings table & repo, tests 2025-07-12 20:21:34 +03:00
Yiorgis Gozadinos
2f261a33f5
Allow multiple tool calling rounds in QA agent 2025-07-08 12:51:58 +03:00
Yiorgis Gozadinos
bea96f1b1b
Better prompts 2025-07-04 13:29:51 +03:00
Yiorgis Gozadinos
1705e7a21c
Honour QA_MODEL for anthropic and OpenAI 2025-07-04 12:14:13 +03:00
Yiorgis Gozadinos
e66c160055
Support for anthropic in Question/Answering 2025-07-04 11:55:03 +03:00
Yiorgis Gozadinos
27e1c9fd49
Show settings command 2025-07-04 11:54:16 +03:00
Yiorgis Gozadinos
85443ee963
Turn rebuild into a generator, track progress in command line 2025-07-02 11:10:31 +03:00
Yiorgis Gozadinos
11d9f2701e
Rebuild database in client & cli 2025-07-02 10:55:06 +03:00
Yiorgis Gozadinos
954e96370a
Log document uri, meta in search results 2025-06-29 09:26:33 +03:00
Yiorgis Gozadinos
e5d8396d1b
Merge pull request #5 from ggozad/feat/qa
Question/Answering using LLMs
2025-06-28 09:41:55 +03:00
Yiorgis Gozadinos
4bbc23dbd4
Add QA to client, cli 2025-06-28 09:21:45 +03:00