Yiorgis Gozadinos
|
e97d235c98
|
Unify update_document, update_document_fields
|
2025-12-08 15:56:02 +02:00 |
|
Yiorgis Gozadinos
|
16ba3a9962
|
Remove create_chunks_for_document from repositories
|
2025-12-08 15:56:01 +02:00 |
|
Yiorgis Gozadinos
|
17c7147a49
|
Remove pre-processor, no longer needed
|
2025-12-08 15:56:01 +02:00 |
|
Yiorgis Gozadinos
|
69b1afa534
|
Remove _create_and_chunk & _update_and_rechunk, keep storage independent of chunking
|
2025-12-08 15:55:31 +02:00 |
|
Yiorgis Gozadinos
|
0ab43d62cd
|
Refactor create_document(), create_document_from_source() to use primitives
|
2025-12-08 15:55:30 +02:00 |
|
Yiorgis Gozadinos
|
e299aed788
|
contextualize() and embed_chunks() utilities in embeddings
|
2025-12-08 15:55:30 +02:00 |
|
Yiorgis Gozadinos
|
4fbb4609b6
|
HaikuRag.chunk() utility method
|
2025-12-08 15:55:30 +02:00 |
|
Yiorgis Gozadinos
|
ace915473c
|
HaikuRag.convert() utility method
|
2025-12-08 15:55:30 +02:00 |
|
Yiorgis Gozadinos
|
ab57c55eaa
|
Drop ChunkWithMetadata, use good old Chunk
|
2025-12-08 15:55:30 +02:00 |
|
Yiorgis Gozadinos
|
33e6a36290
|
Make document import/update handling consistent for DoclingDocument
|
2025-12-08 15:55:29 +02:00 |
|
Yiorgis Gozadinos
|
60ab864fc1
|
Add docling_document_json to update_document_fields() and
|
2025-12-08 15:55:29 +02:00 |
|
Yiorgis Gozadinos
|
8e30f67266
|
Introduce import_document(), remove chunks from create_document()
|
2025-12-08 15:55:29 +02:00 |
|
Yiorgis Gozadinos
|
de14bb9f90
|
Avoid citation meta inside LLM context
|
2025-12-08 15:55:28 +02:00 |
|
Yiorgis Gozadinos
|
a57203065a
|
Fix test
|
2025-12-08 15:55:28 +02:00 |
|
Yiorgis Gozadinos
|
84f25f0627
|
Visual grounding in ag-ui-example
|
2025-12-08 15:55:28 +02:00 |
|
Yiorgis Gozadinos
|
6e31ea38a8
|
Remove bounding boxes from citations, pass sources meta info from ResearchContext
|
2025-12-08 15:55:28 +02:00 |
|
Yiorgis Gozadinos
|
75a086bae0
|
Visualize chunk command, format citations to show chunk id
|
2025-12-08 15:55:28 +02:00 |
|
Yiorgis Gozadinos
|
910d382748
|
Introduce visualize_chunk(), refactor inspector to use it
|
2025-12-08 15:55:27 +02:00 |
|
Yiorgis Gozadinos
|
bfdaa4652a
|
Configure logging regardsless of the env
|
2025-12-08 15:55:27 +02:00 |
|
Yiorgis Gozadinos
|
9382a6b132
|
expose citations in ag-ui-example
|
2025-12-08 15:55:27 +02:00 |
|
Yiorgis Gozadinos
|
d808c6c425
|
Simplify citations in qa & graph agents
|
2025-12-08 15:55:27 +02:00 |
|
Yiorgis Gozadinos
|
16a97cc140
|
Properly expand context in the case of docling documents and merge chunks and meta
|
2025-12-08 15:55:26 +02:00 |
|
Yiorgis Gozadinos
|
ac439b6c69
|
Store raw text (do not contextualize) in chunk.text. Embed with contextualized text.
|
2025-12-08 15:55:26 +02:00 |
|
Yiorgis Gozadinos
|
0d8691342a
|
Show bounding boxes for chunks in inspector
|
2025-12-08 15:55:26 +02:00 |
|
Yiorgis Gozadinos
|
6ab990b2ed
|
Always generate page images, default in docling-serve
|
2025-12-08 15:54:57 +02:00 |
|
Yiorgis Gozadinos
|
c69b934eac
|
Incorporate additional docling meta in search(), expand_context() and relevant qa/research agents
|
2025-12-08 15:54:56 +02:00 |
|
Yiorgis Gozadinos
|
fe4ac530be
|
DB migration
|
2025-12-08 15:54:56 +02:00 |
|
Yiorgis Gozadinos
|
d267b2c433
|
LRU cache for DoclingDocument
|
2025-12-08 15:54:31 +02:00 |
|
Yiorgis Gozadinos
|
a5d8af07e9
|
Resolve DoclingDocument
|
2025-12-08 15:54:31 +02:00 |
|
Yiorgis Gozadinos
|
84aa46a10b
|
Update rebuild to handle DoclingDocument json
|
2025-12-08 15:54:31 +02:00 |
|
Yiorgis Gozadinos
|
ad4e79ab5d
|
Store DoclingDocument json
|
2025-12-08 15:54:31 +02:00 |
|
Yiorgis Gozadinos
|
343272d6fb
|
Chunkers return chunks with metadata, i.e. (refs, labels, headings, page_numbers)
|
2025-12-08 15:54:31 +02:00 |
|
Yiorgis Gozadinos
|
44e8d7b340
|
Update Document & Chunk schemas to include DoclingDocument references.
|
2025-12-08 15:54:30 +02:00 |
|
Yiorgis Gozadinos
|
80447c9024
|
Make download_models() a HaikuRAG client method. Update app to show progress of what happens.
|
2025-12-04 16:30:26 +02:00 |
|
Yiorgis Gozadinos
|
78f1d0cef5
|
No warnings, just info on db upgrade
|
2025-12-03 08:51:25 +02:00 |
|
Yiorgis Gozadinos
|
33b254ae3d
|
Always upgrade database on access. Explicitly create db by running init or HaikuRAG(path, create=True)
|
2025-12-02 16:49:55 +02:00 |
|
Yiorgis Gozadinos
|
3525fae625
|
Use EmbeddingModelConfig similar to ModelConfig for embeddings
|
2025-12-02 11:55:31 +02:00 |
|
Yiorgis Gozadinos
|
f07590bd5b
|
vb
|
2025-12-01 17:58:47 +02:00 |
|
Yiorgis Gozadinos
|
e548a51ff7
|
Optimized rebuild --embed-only to use batch updates via LanceDB merge_insert instead of individual chunk updates
|
2025-12-01 17:53:27 +02:00 |
|
Yiorgis Gozadinos
|
3e18a5f2ff
|
Update project description
|
2025-11-29 11:18:53 +02:00 |
|
Yiorgis Gozadinos
|
10aa2a7cf2
|
vb
|
2025-11-28 10:15:59 +02:00 |
|
Yiorgis Gozadinos
|
88a4edb537
|
--embed-only, --rechunk options in rebuild command
|
2025-11-28 10:11:52 +02:00 |
|
Yiorgis Gozadinos
|
8a0cc04181
|
Add opencv-python-headless to docling optional dependency, required for TableStructureModel which uses TableFormer for table detection.
|
2025-11-27 16:22:37 +02:00 |
|
Yiorgis Gozadinos
|
eee29578ba
|
vb
|
2025-11-27 15:24:39 +02:00 |
|
Yiorgis Gozadinos
|
b4602b0cab
|
use OcrAutoOptions for automatic OCR engine selection.
|
2025-11-27 15:23:17 +02:00 |
|
Yiorgis Gozadinos
|
51104ddb5a
|
Use httpx for docling-serve
|
2025-11-27 15:06:13 +02:00 |
|
Yiorgis Gozadinos
|
3959ce39f7
|
vb
|
2025-11-27 13:06:04 +02:00 |
|
Yiorgis Gozadinos
|
ed53ec461a
|
Convert prefetch_models() to async
|
2025-11-26 18:08:48 +02:00 |
|
Yiorgis Gozadinos
|
e40c352026
|
Switch from requests to httpx.AsyncClient for docling-serve
|
2025-11-26 18:00:29 +02:00 |
|
Yiorgis Gozadinos
|
14bdb7cb27
|
async versions for convert_file() convert_text()
|
2025-11-26 17:46:25 +02:00 |
|