Commit graph

747 commits

Author SHA1 Message Date
Yiorgis Gozadinos
cc72c610a1
HaikuRag.convert() utility method 2025-12-05 11:46:52 +02:00
Yiorgis Gozadinos
c2f0bd9a21
Drop ChunkWithMetadata, use good old Chunk 2025-12-05 10:31:05 +02:00
Yiorgis Gozadinos
0f5bd912fd
Make document import/update handling consistent for DoclingDocument 2025-12-04 12:57:08 +02:00
Yiorgis Gozadinos
bbda27e079
Add docling_document_json to update_document_fields() and 2025-12-04 12:42:10 +02:00
Yiorgis Gozadinos
ebe834d749
Introduce import_document(), remove chunks from create_document() 2025-12-04 11:40:09 +02:00
Yiorgis Gozadinos
c20330655c
Visual grounding docs 2025-12-04 11:23:07 +02:00
Yiorgis Gozadinos
4436dd80cd
Avoid citation meta inside LLM context 2025-12-03 18:21:13 +02:00
Yiorgis Gozadinos
a46aa32817
Fix test 2025-12-03 16:41:01 +02:00
Yiorgis Gozadinos
a43322cf90
Update ag-ui-example UI with STATE_DELTA instead of ACTIVITY_SNAPSHOT since these are not handled by copilotkit 2025-12-03 15:33:06 +02:00
Yiorgis Gozadinos
6bddca8683
Visual grounding in ag-ui-example 2025-12-03 14:53:15 +02:00
Yiorgis Gozadinos
e11e76c296
Remove bounding boxes from citations, pass sources meta info from ResearchContext 2025-12-03 13:55:21 +02:00
Yiorgis Gozadinos
da4e1af28c
Visualize chunk command, format citations to show chunk id 2025-12-03 13:32:09 +02:00
Yiorgis Gozadinos
a9e3901462
Introduce visualize_chunk(), refactor inspector to use it 2025-12-03 11:58:33 +02:00
Yiorgis Gozadinos
5258901fbc
Configure logging regardsless of the env 2025-12-03 09:59:20 +02:00
Yiorgis Gozadinos
139656e2c0
Fix after rebase 2025-12-03 09:37:37 +02:00
Yiorgis Gozadinos
7c4dfebe0b
expose citations in ag-ui-example 2025-12-03 09:37:30 +02:00
Yiorgis Gozadinos
b908e4aa1f
Simplify citations in qa & graph agents 2025-12-03 09:12:30 +02:00
Yiorgis Gozadinos
28afccc6c0
Properly expand context in the case of docling documents and merge chunks and meta 2025-12-03 09:11:53 +02:00
Yiorgis Gozadinos
4bc3a768ec
Store raw text (do not contextualize) in chunk.text. Embed with contextualized text. 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
b22ffa1c9e
Show bounding boxes for chunks in inspector 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
0aa9d8e413
Always generate page images, default in docling-serve 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
c2357c563d
Update evaluations and a2a 2025-12-03 09:11:52 +02:00
Yiorgis Gozadinos
37e950a923
Incorporate additional docling meta in search(), expand_context() and relevant qa/research agents 2025-12-03 09:11:51 +02:00
Yiorgis Gozadinos
b775983451
DB migration 2025-12-03 09:10:39 +02:00
Yiorgis Gozadinos
c9652b20be
LRU cache for DoclingDocument 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
23789626b0
Resolve DoclingDocument 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
4bcbe7f321
Update rebuild to handle DoclingDocument json 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
65ecb3c816
Store DoclingDocument json 2025-12-03 09:09:11 +02:00
Yiorgis Gozadinos
fdc7de6332
Chunkers return chunks with metadata, i.e. (refs, labels, headings, page_numbers) 2025-12-03 09:09:10 +02:00
Yiorgis Gozadinos
0361469f54
Update Document & Chunk schemas to include DoclingDocument references. 2025-12-03 09:09:10 +02:00
Yiorgis Gozadinos
e890add8cc
pyproject keywords 2025-12-03 08:59:22 +02:00
Yiorgis Gozadinos
4e30637d61
vb 2025-12-03 08:57:14 +02:00
Yiorgis Gozadinos
f631e74bf1
Merge pull request #176 from ggozad/fix/embedding-model-config
Always perform db upgrades, introduce `init` to create a db, update embeddings configuration.
2025-12-03 08:54:59 +02:00
Yiorgis Gozadinos
78f1d0cef5
No warnings, just info on db upgrade 2025-12-03 08:51:25 +02:00
Yiorgis Gozadinos
33b254ae3d
Always upgrade database on access. Explicitly create db by running init or HaikuRAG(path, create=True) 2025-12-02 16:49:55 +02:00
Yiorgis Gozadinos
47d8f7ba3f
Update docs 2025-12-02 12:01:10 +02:00
Yiorgis Gozadinos
3525fae625
Use EmbeddingModelConfig similar to ModelConfig for embeddings 2025-12-02 11:55:31 +02:00
Yiorgis Gozadinos
f07590bd5b
vb 2025-12-01 17:58:47 +02:00
Yiorgis Gozadinos
80ff2fa509
Merge pull request #174 from ggozad/fix/optimize-batch-update-chunks
Optimized `rebuild --embed-only` to use batch updates
2025-12-01 17:57:51 +02:00
Yiorgis Gozadinos
e548a51ff7
Optimized rebuild --embed-only to use batch updates via LanceDB merge_insert instead of individual chunk updates 2025-12-01 17:53:27 +02:00
Yiorgis Gozadinos
3e18a5f2ff
Update project description 2025-11-29 11:18:53 +02:00
Yiorgis Gozadinos
37c9d088af
Merge pull request #173 from ggozad/chore/improve-documentation
Improve documentation
2025-11-28 13:11:30 +02:00
Yiorgis Gozadinos
e10b207b47
Improve documentation 2025-11-28 13:10:03 +02:00
Yiorgis Gozadinos
5dfa07cb2c
Update benchmarks 2025-11-28 12:10:08 +02:00
Yiorgis Gozadinos
10aa2a7cf2
vb 2025-11-28 10:15:59 +02:00
Yiorgis Gozadinos
fc44cb2286
Merge pull request #171 from ggozad/feat/rebuild-options
New options for `rebuild` command to control what gets rebuilt
2025-11-28 10:13:37 +02:00
Yiorgis Gozadinos
88a4edb537
--embed-only, --rechunk options in rebuild command 2025-11-28 10:11:52 +02:00
Yiorgis Gozadinos
9302de0aff
Merge pull request #170 from ggozad/fix/docling-tables-local
Add opencv-python-headless to docling optional dependency, required for table detection.
2025-11-27 16:23:41 +02:00
Yiorgis Gozadinos
8a0cc04181
Add opencv-python-headless to docling optional dependency, required for TableStructureModel which uses TableFormer for table detection. 2025-11-27 16:22:37 +02:00
Yiorgis Gozadinos
eee29578ba
vb 2025-11-27 15:24:39 +02:00