7 commits

Author	SHA1	Message	Date
Yiorgis Gozadinos	75cbdb47a8	Add chunker configuration options ... - Add `chunker_type` config field to choose between "hybrid" (default) and "hierarchical" chunking strategies - Add `chunking_merge_peers` config field for HybridChunker (default: true) - Add `chunking_use_markdown_tables` config field to control table serialization format (default: false, matching docling's default)	2025-11-17 13:05:06 +02:00
Yiorgis Gozadinos	de5bb117fe	Chunker abstraction	2025-11-17 13:05:06 +02:00
Yiorgis Gozadinos	541552215e	Switch to using HuggingFace tokenizers	2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos	7ba1c2376e	Introduce converters for supporting more than local docling document conversion. Transform existing FileReader and utils to "docling-local" converter	2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos	ad4b655a31	Operate on DoclingDocument instead of Document	2025-08-08 17:24:34 +02:00
Yiorgis Gozadinos	91f6122ef7	Basic chunking using docling	2025-08-01 16:27:44 +02:00
Yiorgis Gozadinos	6c948a4afd	Chucker & tests	2025-06-15 21:08:06 +02:00