Commit graph

760 commits

Author SHA1 Message Date
Yiorgis Gozadinos
4c4d2ce0bc
Merge pull request #180 from ggozad/feat/search-context-enhancement
Add type-aware context expansion for search results
2025-12-08 11:38:17 +02:00
Yiorgis Gozadinos
b2abb534e5
Add type-aware context expansion for search results 2025-12-08 11:35:44 +02:00
Yiorgis Gozadinos
dc7e27d6b7
Dependency updates 2025-12-05 15:18:00 +02:00
Yiorgis Gozadinos
237cd8642e
Remove unecessary tests, add no coverage pragmas where appropriate 2025-12-05 15:00:09 +02:00
Yiorgis Gozadinos
c106250b82
Update docs 2025-12-05 14:30:23 +02:00
Yiorgis Gozadinos
2316229ba8
Move embedding logic from ChunkRepository to client._ensure_chunks_embedded() 2025-12-05 14:24:13 +02:00
Yiorgis Gozadinos
df8c079636
Unify update_document, update_document_fields 2025-12-05 14:16:04 +02:00
Yiorgis Gozadinos
872ca105e6
Remove create_chunks_for_document from repositories 2025-12-05 13:43:41 +02:00
Yiorgis Gozadinos
91162e7a97
Remove pre-processor, no longer needed 2025-12-05 13:04:13 +02:00
Yiorgis Gozadinos
fc5fb5f293
Remove _create_and_chunk & _update_and_rechunk, keep storage independent of chunking 2025-12-05 12:52:48 +02:00
Yiorgis Gozadinos
c1c82b6675
Refactor create_document(), create_document_from_source() to use primitives 2025-12-05 12:16:20 +02:00
Yiorgis Gozadinos
68e2068745
contextualize() and embed_chunks() utilities in embeddings 2025-12-05 11:58:50 +02:00
Yiorgis Gozadinos
5458f9cac5
HaikuRag.chunk() utility method 2025-12-05 11:49:57 +02:00
Yiorgis Gozadinos
cc72c610a1
HaikuRag.convert() utility method 2025-12-05 11:46:52 +02:00
Yiorgis Gozadinos
c2f0bd9a21
Drop ChunkWithMetadata, use good old Chunk 2025-12-05 10:31:05 +02:00
Yiorgis Gozadinos
0f5bd912fd
Make document import/update handling consistent for DoclingDocument 2025-12-04 12:57:08 +02:00
Yiorgis Gozadinos
bbda27e079
Add docling_document_json to update_document_fields() and 2025-12-04 12:42:10 +02:00
Yiorgis Gozadinos
ebe834d749
Introduce import_document(), remove chunks from create_document() 2025-12-04 11:40:09 +02:00
Yiorgis Gozadinos
c20330655c
Visual grounding docs 2025-12-04 11:23:07 +02:00
Yiorgis Gozadinos
4436dd80cd
Avoid citation meta inside LLM context 2025-12-03 18:21:13 +02:00
Yiorgis Gozadinos
a46aa32817
Fix test 2025-12-03 16:41:01 +02:00
Yiorgis Gozadinos
a43322cf90
Update ag-ui-example UI with STATE_DELTA instead of ACTIVITY_SNAPSHOT since these are not handled by copilotkit 2025-12-03 15:33:06 +02:00
Yiorgis Gozadinos
6bddca8683
Visual grounding in ag-ui-example 2025-12-03 14:53:15 +02:00
Yiorgis Gozadinos
e11e76c296
Remove bounding boxes from citations, pass sources meta info from ResearchContext 2025-12-03 13:55:21 +02:00
Yiorgis Gozadinos
da4e1af28c
Visualize chunk command, format citations to show chunk id 2025-12-03 13:32:09 +02:00
Yiorgis Gozadinos
a9e3901462
Introduce visualize_chunk(), refactor inspector to use it 2025-12-03 11:58:33 +02:00
Yiorgis Gozadinos
5258901fbc
Configure logging regardsless of the env 2025-12-03 09:59:20 +02:00
Yiorgis Gozadinos
139656e2c0
Fix after rebase 2025-12-03 09:37:37 +02:00
Yiorgis Gozadinos
7c4dfebe0b
expose citations in ag-ui-example 2025-12-03 09:37:30 +02:00
Yiorgis Gozadinos
b908e4aa1f
Simplify citations in qa & graph agents 2025-12-03 09:12:30 +02:00
Yiorgis Gozadinos
28afccc6c0
Properly expand context in the case of docling documents and merge chunks and meta 2025-12-03 09:11:53 +02:00
Yiorgis Gozadinos
4bc3a768ec
Store raw text (do not contextualize) in chunk.text. Embed with contextualized text. 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
b22ffa1c9e
Show bounding boxes for chunks in inspector 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
0aa9d8e413
Always generate page images, default in docling-serve 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
c2357c563d
Update evaluations and a2a 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
37e950a923
Incorporate additional docling meta in search(), expand_context() and relevant qa/research agents 2025-12-03 09:11:51 +02:00
Yiorgis Gozadinos
b775983451
DB migration 2025-12-03 09:10:39 +02:00
Yiorgis Gozadinos
c9652b20be
LRU cache for DoclingDocument 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
23789626b0
Resolve DoclingDocument 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
4bcbe7f321
Update rebuild to handle DoclingDocument json 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
65ecb3c816
Store DoclingDocument json 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
fdc7de6332
Chunkers return chunks with metadata, i.e. (refs, labels, headings, page_numbers) 2025-12-03 09:09:10 +02:00
Yiorgis Gozadinos
0361469f54
Update Document & Chunk schemas to include DoclingDocument references. 2025-12-03 09:09:10 +02:00
Yiorgis Gozadinos
e890add8cc
pyproject keywords 2025-12-03 08:59:22 +02:00
Yiorgis Gozadinos
4e30637d61
vb 2025-12-03 08:57:14 +02:00
Yiorgis Gozadinos
f631e74bf1
Merge pull request #176 from ggozad/fix/embedding-model-config
Always perform db upgrades, introduce `init` to create a db, update embeddings configuration.
2025-12-03 08:54:59 +02:00
Yiorgis Gozadinos
78f1d0cef5
No warnings, just info on db upgrade 2025-12-03 08:51:25 +02:00
Yiorgis Gozadinos
33b254ae3d
Always upgrade database on access. Explicitly create db by running init or HaikuRAG(path, create=True) 2025-12-02 16:49:55 +02:00
Yiorgis Gozadinos
47d8f7ba3f
Update docs 2025-12-02 12:01:10 +02:00
Yiorgis Gozadinos
3525fae625
Use EmbeddingModelConfig similar to ModelConfig for embeddings 2025-12-02 11:55:31 +02:00