Commit graph

740 commits

Author SHA1 Message Date
Yiorgis Gozadinos
6e31ea38a8
Remove bounding boxes from citations, pass sources meta info from ResearchContext 2025-12-08 15:55:28 +02:00
Yiorgis Gozadinos
75a086bae0
Visualize chunk command, format citations to show chunk id 2025-12-08 15:55:28 +02:00
Yiorgis Gozadinos
910d382748
Introduce visualize_chunk(), refactor inspector to use it 2025-12-08 15:55:27 +02:00
Yiorgis Gozadinos
bfdaa4652a
Configure logging regardsless of the env 2025-12-08 15:55:27 +02:00
Yiorgis Gozadinos
b5bd56e110
Fix after rebase 2025-12-08 15:55:27 +02:00
Yiorgis Gozadinos
9382a6b132
expose citations in ag-ui-example 2025-12-08 15:55:27 +02:00
Yiorgis Gozadinos
d808c6c425
Simplify citations in qa & graph agents 2025-12-08 15:55:27 +02:00
Yiorgis Gozadinos
16a97cc140
Properly expand context in the case of docling documents and merge chunks and meta 2025-12-08 15:55:26 +02:00
Yiorgis Gozadinos
ac439b6c69
Store raw text (do not contextualize) in chunk.text. Embed with contextualized text. 2025-12-08 15:55:26 +02:00
Yiorgis Gozadinos
0d8691342a
Show bounding boxes for chunks in inspector 2025-12-08 15:55:26 +02:00
Yiorgis Gozadinos
6ab990b2ed
Always generate page images, default in docling-serve 2025-12-08 15:54:57 +02:00
Yiorgis Gozadinos
ace58a7034
Update evaluations and a2a 2025-12-08 15:54:56 +02:00
Yiorgis Gozadinos
c69b934eac
Incorporate additional docling meta in search(), expand_context() and relevant qa/research agents 2025-12-08 15:54:56 +02:00
Yiorgis Gozadinos
fe4ac530be
DB migration 2025-12-08 15:54:56 +02:00
Yiorgis Gozadinos
d267b2c433
LRU cache for DoclingDocument 2025-12-08 15:54:31 +02:00
Yiorgis Gozadinos
a5d8af07e9
Resolve DoclingDocument 2025-12-08 15:54:31 +02:00
Yiorgis Gozadinos
84aa46a10b
Update rebuild to handle DoclingDocument json 2025-12-08 15:54:31 +02:00
Yiorgis Gozadinos
ad4e79ab5d
Store DoclingDocument json 2025-12-08 15:54:31 +02:00
Yiorgis Gozadinos
343272d6fb
Chunkers return chunks with metadata, i.e. (refs, labels, headings, page_numbers) 2025-12-08 15:54:31 +02:00
Yiorgis Gozadinos
44e8d7b340
Update Document & Chunk schemas to include DoclingDocument references. 2025-12-08 15:54:30 +02:00
Yiorgis Gozadinos
e7f2981b13
Merge pull request #179 from ggozad/feat/client-download-models
Make download_models() a HaikuRAG client method, show updates in app.
2025-12-08 15:51:54 +02:00
Yiorgis Gozadinos
0dc4458070
Fix qa accuracy table for wix 2025-12-06 12:01:13 +02:00
Yiorgis Gozadinos
80447c9024
Make download_models() a HaikuRAG client method. Update app to show progress of what happens. 2025-12-04 16:30:26 +02:00
Yiorgis Gozadinos
e890add8cc
pyproject keywords 2025-12-03 08:59:22 +02:00
Yiorgis Gozadinos
4e30637d61
vb 2025-12-03 08:57:14 +02:00
Yiorgis Gozadinos
f631e74bf1
Merge pull request #176 from ggozad/fix/embedding-model-config
Always perform db upgrades, introduce `init` to create a db, update embeddings configuration.
2025-12-03 08:54:59 +02:00
Yiorgis Gozadinos
78f1d0cef5
No warnings, just info on db upgrade 2025-12-03 08:51:25 +02:00
Yiorgis Gozadinos
33b254ae3d
Always upgrade database on access. Explicitly create db by running init or HaikuRAG(path, create=True) 2025-12-02 16:49:55 +02:00
Yiorgis Gozadinos
47d8f7ba3f
Update docs 2025-12-02 12:01:10 +02:00
Yiorgis Gozadinos
3525fae625
Use EmbeddingModelConfig similar to ModelConfig for embeddings 2025-12-02 11:55:31 +02:00
Yiorgis Gozadinos
f07590bd5b
vb 2025-12-01 17:58:47 +02:00
Yiorgis Gozadinos
80ff2fa509
Merge pull request #174 from ggozad/fix/optimize-batch-update-chunks
Optimized `rebuild --embed-only` to use batch updates
2025-12-01 17:57:51 +02:00
Yiorgis Gozadinos
e548a51ff7
Optimized rebuild --embed-only to use batch updates via LanceDB merge_insert instead of individual chunk updates 2025-12-01 17:53:27 +02:00
Yiorgis Gozadinos
3e18a5f2ff
Update project description 2025-11-29 11:18:53 +02:00
Yiorgis Gozadinos
37c9d088af
Merge pull request #173 from ggozad/chore/improve-documentation
Improve documentation
2025-11-28 13:11:30 +02:00
Yiorgis Gozadinos
e10b207b47
Improve documentation 2025-11-28 13:10:03 +02:00
Yiorgis Gozadinos
5dfa07cb2c
Update benchmarks 2025-11-28 12:10:08 +02:00
Yiorgis Gozadinos
10aa2a7cf2
vb 2025-11-28 10:15:59 +02:00
Yiorgis Gozadinos
fc44cb2286
Merge pull request #171 from ggozad/feat/rebuild-options
New options for `rebuild` command to control what gets rebuilt
2025-11-28 10:13:37 +02:00
Yiorgis Gozadinos
88a4edb537
--embed-only, --rechunk options in rebuild command 2025-11-28 10:11:52 +02:00
Yiorgis Gozadinos
9302de0aff
Merge pull request #170 from ggozad/fix/docling-tables-local
Add opencv-python-headless to docling optional dependency, required for table detection.
2025-11-27 16:23:41 +02:00
Yiorgis Gozadinos
8a0cc04181
Add opencv-python-headless to docling optional dependency, required for TableStructureModel which uses TableFormer for table detection. 2025-11-27 16:22:37 +02:00
Yiorgis Gozadinos
eee29578ba
vb 2025-11-27 15:24:39 +02:00
Yiorgis Gozadinos
5d00bbf6dd
Merge pull request #169 from ggozad/fix/docling-fixes
Fix docling OCR options.
2025-11-27 15:24:02 +02:00
Yiorgis Gozadinos
b4602b0cab
use OcrAutoOptions for automatic OCR engine selection. 2025-11-27 15:23:17 +02:00
Yiorgis Gozadinos
51104ddb5a
Use httpx for docling-serve 2025-11-27 15:06:13 +02:00
Yiorgis Gozadinos
3959ce39f7
vb 2025-11-27 13:06:04 +02:00
Yiorgis Gozadinos
f6956341ec
Merge pull request #168 from ggozad/fix/async-fixes
Wrap synchronous calls to async.
2025-11-27 13:01:56 +02:00
Yiorgis Gozadinos
bdbd3ce556
cl 2025-11-27 10:43:23 +02:00
Yiorgis Gozadinos
ed53ec461a
Convert prefetch_models() to async 2025-11-26 18:08:48 +02:00