Commit graph

163 commits

Author SHA1 Message Date
Yiorgis Gozadinos
4e2e6e490e
Update extras and docs 2025-08-15 21:44:33 +02:00
Yiorgis Gozadinos
26a3715902
Refactor Ollama reranker around pydantic AI 2025-08-15 21:26:16 +02:00
Yiorgis Gozadinos
390397570a
Migrate QA agent to Pydantic AI. 2025-08-15 21:13:17 +02:00
Yiorgis Gozadinos
ca29178b2d
vb 2025-08-12 16:55:39 +02:00
Yiorgis Gozadinos
74f5cbd3c5
Merge pull request #38 from ggozad/feat/radius-param
Allow radius as parameter to expand_context() for custom tools.
2025-08-12 16:55:01 +02:00
Yiorgis Gozadinos
bf8a4f22be
Make radius a parameter we can pass to expand_context() 2025-08-12 16:53:45 +02:00
Yiorgis Gozadinos
edbd360bca
vb 2025-08-12 15:30:14 +02:00
Yiorgis Gozadinos
3d8682e5c8
vb 2025-08-12 15:28:21 +02:00
Yiorgis Gozadinos
ee44e4b181
Merge pull request #37 from ggozad/feat/adjacent_chunks
Allow expanding the search context with adjacent chunks through CONTEXT_CHUNK_RADIUS
2025-08-12 15:27:15 +02:00
Yiorgis Gozadinos
99f7401817
Merge expanded context if possible 2025-08-12 15:02:07 +02:00
Yiorgis Gozadinos
e7c2a105ed
Use the expand_context when searching in the qa agent 2025-08-12 14:51:33 +02:00
Yiorgis Gozadinos
eb13426aae
expand_context() by using the adjacent chunks 2025-08-12 14:14:18 +02:00
Yiorgis Gozadinos
2f42b1a3ac
Get adjacent chunks method 2025-08-12 13:24:04 +02:00
Yiorgis Gozadinos
b7dde5bd32
Merge pull request #36 from ggozad/feat/citations
Support for requesting citations in the QA agent and ask() methods.
2025-08-12 13:20:33 +02:00
Yiorgis Gozadinos
842e4a882d
Make citations optional, through cite parameter 2025-08-12 13:19:11 +02:00
Yiorgis Gozadinos
a0d0359618
Change prompt and tool definition to to include citations in the QA agent. 2025-08-12 13:05:37 +02:00
Yiorgis Gozadinos
6f50706e8a
Give the results of search to the qa agent as json including the document uri 2025-08-12 12:40:55 +02:00
Yiorgis Gozadinos
3aa347484a
vb 2025-08-11 11:27:28 +02:00
Yiorgis Gozadinos
e39be89666
Merge pull request #33 from ggozad/feat/ollama-reranker
Add custom reranker based on Ollama.
2025-08-11 11:18:42 +02:00
Yiorgis Gozadinos
022f8677b3
Merge pull request #32 from ggozad/chore/slim-deps
Make mxbai reranker optional. Only use a reranker if mxbai or cohere are installed.
2025-08-11 11:18:27 +02:00
Yiorgis Gozadinos
455b148ebc
Merge pull request #35 from ggozad/fix/add-src-url
Fix URL handling in add-src
2025-08-11 11:16:40 +02:00
Yiorgis Gozadinos
9648cb97cb
Fix URL handling in add-src 2025-08-11 11:10:29 +02:00
Yiorgis Gozadinos
ffe867f7bb
Allow to disable reranking by having an empty provider 2025-08-10 21:02:17 +02:00
Yiorgis Gozadinos
5103e6c2d7
Add Ollama reranker 2025-08-10 20:50:17 +02:00
Yiorgis Gozadinos
53c8289790
Update ollama 2025-08-10 20:22:50 +02:00
Yiorgis Gozadinos
8d98eed2e2
Make mxbai reranker optional. Only use a reranker if mxbai or cohere are installed 2025-08-10 19:49:14 +02:00
Yiorgis Gozadinos
ff42224de3
vb 2025-08-08 18:34:25 +02:00
Yiorgis Gozadinos
17608844b5
Merge pull request #31 from ggozad/fix/docling-chunking
Refactor reading & chunking around docling documents.
2025-08-08 18:33:13 +02:00
Yiorgis Gozadinos
0b3477c46c
Rebuild now re-adds files. 2025-08-08 18:30:53 +02:00
Yiorgis Gozadinos
22ed9ca51e
Disable python warning unless in development 2025-08-08 17:31:42 +02:00
Yiorgis Gozadinos
ad4b655a31
Operate on DoclingDocument instead of Document 2025-08-08 17:24:34 +02:00
Yiorgis Gozadinos
6a3c85e6ae
text_to_docling_document() util 2025-08-08 15:38:57 +02:00
Yiorgis Gozadinos
b92f25d6fb
Make FileReader return a DoclingDocument instead of a md string 2025-08-08 14:45:24 +02:00
Yiorgis Gozadinos
7906b1b026
Use absolute paths when add-src 2025-08-08 14:34:13 +02:00
Yiorgis Gozadinos
4efb84e9a5
Merge pull request #30 from ggozad/fix/event-loop
Replace event_loop.run_until_complete() with asyncio.run()
2025-08-08 12:52:30 +02:00
Yiorgis Gozadinos
af95b5f3eb
Replace loop.run_until_complete() with asyncio.run() 2025-08-08 12:41:50 +02:00
Yiorgis Gozadinos
054d09dc98
vb 2025-08-01 17:22:53 +02:00
Yiorgis Gozadinos
2cdee6608d
Merge pull request #27 from ggozad/feat/docling-chunking
Use docling for chunking
2025-08-01 17:22:02 +02:00
Yiorgis Gozadinos
9b4942401f
Fix file extension typo 2025-08-01 17:15:14 +02:00
Yiorgis Gozadinos
ec1bc21a91
Contextualize chunks 2025-08-01 16:54:51 +02:00
Yiorgis Gozadinos
b428cb4c5d
Forgotten test for FileReader 2025-08-01 16:41:24 +02:00
Yiorgis Gozadinos
a453853211
Keep using the openai tokenizer 2025-08-01 16:36:24 +02:00
Yiorgis Gozadinos
91f6122ef7
Basic chunking using docling 2025-08-01 16:27:44 +02:00
Yiorgis Gozadinos
f2db1dbe1f
vb 2025-08-01 16:11:37 +02:00
Yiorgis Gozadinos
75c1cdb36c
Merge pull request #26 from ggozad/feat/docling
Use docling for parsing documents
2025-08-01 16:10:34 +02:00
Yiorgis Gozadinos
4bfd54b2ec
Merge pull request #25 from ggozad/feat/sqlite_wal
Use Write-Ahead Logging jorunaling mode for SQLite concurrency
2025-08-01 16:10:13 +02:00
Yiorgis Gozadinos
13c6411d48
Merge pull request #24 from ggozad/feat/version
Add -v --version option to display version
2025-08-01 16:09:58 +02:00
Yiorgis Gozadinos
14d8b18f1d
Wrap code files in md code blocks 2025-08-01 10:13:46 +02:00
Yiorgis Gozadinos
5a08816ed6
Replace markitdown with docling 2025-08-01 09:59:53 +02:00
Yiorgis Gozadinos
0f2809cb8d
Use Write-Ahead Logging jorunaling mode for SQLite concurrency 2025-08-01 09:07:31 +02:00