Yiorgis Gozadinos
973522ffe2
Documentation
2025-11-17 13:07:46 +02:00
Yiorgis Gozadinos
81b7c7d9d1
Tests for docling-serve chunker
2025-11-17 13:05:06 +02:00
Yiorgis Gozadinos
91de82ec14
docling-serve chunker implementation. Lacks tests
2025-11-17 13:05:06 +02:00
Yiorgis Gozadinos
75cbdb47a8
Add chunker configuration options
...
- Add `chunker_type` config field to choose between "hybrid" (default) and "hierarchical" chunking strategies
- Add `chunking_merge_peers` config field for HybridChunker (default: true)
- Add `chunking_use_markdown_tables` config field to control table serialization format (default: false, matching docling's default)
2025-11-17 13:05:06 +02:00
Yiorgis Gozadinos
de5bb117fe
Chunker abstraction
2025-11-17 13:05:06 +02:00
Yiorgis Gozadinos
541552215e
Switch to using HuggingFace tokenizers
2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos
fe7d0c5c24
Implement docling-serve converter
2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos
92def1c6a5
Rebase after haiku.rag-slim migration
2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos
eb2b65135a
Lazy load docling & friends
2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos
7ba1c2376e
Introduce converters for supporting more than local docling document conversion. Transform existing FileReader and utils to "docling-local" converter
2025-11-17 13:05:05 +02:00
Yiorgis Gozadinos
636d5261e6
vb
2025-11-14 22:29:37 +02:00
Yiorgis Gozadinos
dcba9d9a0e
Benchmarks for qwen3-embedding:0.6b
2025-11-14 15:36:36 +02:00
Yiorgis Gozadinos
8a697249f4
Merge pull request #140 from ggozad/fix/evals-experiment
...
Run entire evaluation dataset as an experiment instead of individual test cases
2025-11-14 11:48:14 +02:00
Yiorgis Gozadinos
adb7d9093d
Run entire evaluation dataset as one so that it appears properly in logfire
2025-11-14 11:39:58 +02:00
Yiorgis Gozadinos
c8999a89b8
Update and lock pydantic-ai-slim
2025-11-14 11:26:09 +02:00
Yiorgis Gozadinos
f55b8c8f19
Load .env in evals
2025-11-14 11:00:58 +02:00
Yiorgis Gozadinos
1fa843c3de
Update uv.lock
2025-11-14 10:40:58 +02:00
Yiorgis Gozadinos
6eb0d59a28
vb
2025-11-13 15:00:57 +02:00
Yiorgis Gozadinos
7140b3410f
Merge pull request #139 from ggozad/fix/create-db-only-on-write
...
Drop disable_auto_create flag, simply create only on write operations
2025-11-13 13:58:14 +02:00
Yiorgis Gozadinos
4599dd1481
Drop disable_auto_create flag, simply create only on write operations
2025-11-13 13:53:11 +02:00
Yiorgis Gozadinos
8e802d4a91
Default vacuum_retention_seconds increased from 60 seconds to 86400 seconds (1 day) for better version retention in typical workflows
2025-11-13 13:31:53 +02:00
Yiorgis Gozadinos
cb1001dc29
Merge pull request #136 from ggozad/feat/ag-ui
...
AG-UI support in research / deep ask graphs.
2025-11-13 13:30:41 +02:00
Yiorgis Gozadinos
2c43f034de
Refactor ag-ui-research. Drop human-in-the-loop, use MemoryObjectSendStream to merge the graph and agent streams together
2025-11-13 13:22:53 +02:00
Yiorgis Gozadinos
4a623934b2
Log additional ag-ui events in the cli renderer
2025-11-13 13:22:52 +02:00
Yiorgis Gozadinos
0c8d2838b2
Better typing
2025-11-13 13:22:52 +02:00
Yiorgis Gozadinos
68d1127e46
Compute and emit state deltas instead of full state snapshots by default
2025-11-13 13:22:52 +02:00
Yiorgis Gozadinos
657245f686
Simplify InsightRecord, GapRecord
2025-11-13 13:22:52 +02:00
Yiorgis Gozadinos
2060898018
Use a node factor for common nodes
2025-11-13 13:22:52 +02:00
Yiorgis Gozadinos
888c9e338e
Changelog
2025-11-13 13:22:51 +02:00
Yiorgis Gozadinos
032625b0bb
Refactor everything graph-related under the graph module
2025-11-13 13:22:03 +02:00
Yiorgis Gozadinos
8f0597e89e
Update deep ask graph
2025-11-13 13:22:03 +02:00
Yiorgis Gozadinos
ed27acc1a2
Update docs
2025-11-13 13:22:02 +02:00
Yiorgis Gozadinos
d5b6ad544d
Bring back verbose
2025-11-13 13:22:02 +02:00
Yiorgis Gozadinos
dccef431b0
Update tests
2025-11-13 13:22:02 +02:00
Yiorgis Gozadinos
60ef8fe04c
AGUI starlette server
2025-11-13 13:22:02 +02:00
Yiorgis Gozadinos
2c1f79614a
Use StateSnapshot updates
2025-11-13 13:22:02 +02:00
Yiorgis Gozadinos
663a7fac9a
Replace console/stream with AG-UI event protocol
2025-11-13 13:22:01 +02:00
Yiorgis Gozadinos
da77e0f2f9
Convert ResearchState from dataclass to Pydantic model
2025-11-13 13:22:01 +02:00
Yiorgis Gozadinos
765ebb698f
AG-UI Event-emitter for graphs. Compute state-deltas from from BaseModel pydantic state models
2025-11-13 13:22:01 +02:00
Yiorgis Gozadinos
d2771399a7
Merge pull request #138 from ggozad/fix/create-with-chunks
...
Do not create unecessary DoclingDocument when chunks are provided.
2025-11-13 13:20:39 +02:00
Yiorgis Gozadinos
908296e155
Do not create unecessary DoclingDocument when chunks are provided. Rename private _create_with_docling & _update_with_docling to _create_and_chunk & _update_and_rechunk
2025-11-13 13:16:15 +02:00
Yiorgis Gozadinos
942ad2818f
Filereader error messages now include both original exception details and file path for easier debugging
2025-11-10 18:26:25 +02:00
Yiorgis Gozadinos
34f50f37a0
vb
2025-11-07 14:44:58 +02:00
Yiorgis Gozadinos
51d64259fd
Merge pull request #135 from ggozad/feat/monitor-improvements
...
Optional orphan deletion when monitoring. Fix skipping updates of non-changed files.
2025-11-07 14:40:49 +02:00
Yiorgis Gozadinos
b6650d0486
Introduce delete_orphans in monitor (default=false) to delete db entries that do not resolve in the filesystem
2025-11-07 14:40:13 +02:00
Yiorgis Gozadinos
31713e5fb6
Properly skip (and log as such) documents without changing updated_at when the md5 hash is unchanged
2025-11-07 14:00:05 +02:00
Yiorgis Gozadinos
9f68349ea4
Merge pull request #134 from ggozad/chore/a2a-removal
...
Remove A2A from haiku.rag, turn it into an example
2025-11-07 13:34:36 +02:00
Yiorgis Gozadinos
9ee64a33e0
Remove A2A from haiku.rag, turn it into an example
2025-11-07 13:31:51 +02:00
Yiorgis Gozadinos
40ecaa0e0b
Merge pull request #133 from ggozad/fix/config
...
All CLI commands now properly support `--config` parameter for specifying custom configuration files. Remove support for environment variables.
2025-11-07 11:58:59 +02:00
Yiorgis Gozadinos
7ef7aaad4e
Remove deprecation note
2025-11-07 11:58:13 +02:00
