Commit graph

965 commits

Author SHA1 Message Date
Yiorgis Gozadinos
c9cbf04cc8
Reverted docling from 2.67.0 to 2.65.0 to use docling-document 1.8.0 2026-01-13 18:22:58 +02:00
Yiorgis Gozadinos
eb5d0b0622
Use tui as an optional group. vb 2026-01-13 12:30:19 +02:00
Yiorgis Gozadinos
e9efe69136
Update bump version script 2026-01-13 12:21:55 +02:00
Yiorgis Gozadinos
f3b644a2a3
Update docs for app 2026-01-13 12:18:13 +02:00
Yiorgis Gozadinos
3bb1721e0f
Merge pull request #224 from ggozad/feat/haiku.rag.app
Add conversational RAG application with chat agent module
2026-01-13 12:10:27 +02:00
Yiorgis Gozadinos
f6bb3c2d33
Update README 2026-01-13 12:02:14 +02:00
Yiorgis Gozadinos
567e50be1f
Update documentation 2026-01-13 11:59:21 +02:00
Yiorgis Gozadinos
525e5f9831
Fix vaccum test 2026-01-13 11:55:04 +02:00
Yiorgis Gozadinos
6b3ff5ef1e
CLI app 2026-01-13 11:31:21 +02:00
Yiorgis Gozadinos
100933b36e
update cl 2026-01-12 17:21:41 +02:00
Yiorgis Gozadinos
3e66d6b21d
Make qa list a FIFO with 50 max, keep a cache of embeddings 2026-01-12 17:02:23 +02:00
Yiorgis Gozadinos
ce326d80ff
Disable ocr in tests previously marked as integration 2026-01-12 16:19:25 +02:00
Yiorgis Gozadinos
52363639a6
Remove integration marker from tests that have vcr 2026-01-12 16:03:05 +02:00
Yiorgis Gozadinos
51836a1c55
Add tests for chat agent & friends 2026-01-12 16:00:07 +02:00
Yiorgis Gozadinos
f4ddb0f5c6
Allow chat agent to specify the search limit 2026-01-12 15:52:40 +02:00
Yiorgis Gozadinos
2da2c6d13a
Search tool in chat agent needs no search context 2026-01-12 15:13:43 +02:00
Yiorgis Gozadinos
5adab04e50
Update prompts 2026-01-12 15:10:04 +02:00
Yiorgis Gozadinos
d43821659c
Filter low-confidence answers 2026-01-12 15:01:32 +02:00
Yiorgis Gozadinos
e4a7d86348
Rank q/a history with respect to cosine similarity to new queries. Adapt the chat agent to only pass relevant q/as 2026-01-12 14:15:36 +02:00
Yiorgis Gozadinos
a9ed178a90
Research graph test cassette 2026-01-12 12:43:51 +02:00
Yiorgis Gozadinos
7cc561d1db
Refactor to make agents a top-level module. Bring in the conversational agent from the app 2026-01-12 12:37:08 +02:00
Yiorgis Gozadinos
fc29b0c3f7
Update docs 2026-01-12 12:37:08 +02:00
Yiorgis Gozadinos
bb61e8fab6
Remove custom AG-UI infrastructure in favor of pydantic-ai native support 2026-01-12 12:37:07 +02:00
Yiorgis Gozadinos
baefbe9416
Tool calling in the frontend 2026-01-12 12:36:32 +02:00
Yiorgis Gozadinos
f2fb64cbca
Remove custom ag-ui from app backend. 2026-01-12 12:36:32 +02:00
Yiorgis Gozadinos
26bc02ef14
Build a "conversational" research graph 2026-01-12 12:36:31 +02:00
Yiorgis Gozadinos
df71e7a893
Adapt search to show complete results 2026-01-12 12:36:31 +02:00
Yiorgis Gozadinos
8579ded7bb
Natural language filtering 2026-01-12 12:36:31 +02:00
Yiorgis Gozadinos
36f964eaa9
get_document() 2026-01-12 12:36:31 +02:00
Yiorgis Gozadinos
a6a60963c0
Add SSE heartbeat to prevent connection timeouts
Sends SSE comment every 15 seconds during long LLM operations
to keep the connection alive and prevent body timeout errors.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-12 12:36:30 +02:00
Yiorgis Gozadinos
8b7c679159
Add SearchAgent for internal query expansion
SearchAgent generates 2-4 diverse search queries internally,
runs them against the knowledge base, deduplicates by chunk_id,
and returns consolidated results. This prevents the outer chat
agent from making multiple search calls.

Also updates system prompt to enforce single tool calls per message.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-12 12:36:30 +02:00
Yiorgis Gozadinos
49f5c20757
Mount haiku.rag.yaml config in docker compose
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-12 12:36:30 +02:00
Yiorgis Gozadinos
18cec25fc9
Visual grounding; 2026-01-12 12:36:30 +02:00
Yiorgis Gozadinos
72b66dd3d8
Styling 2026-01-12 12:36:30 +02:00
Yiorgis Gozadinos
6ba28244d8
Logfire integration for debugging 2026-01-12 12:36:29 +02:00
Yiorgis Gozadinos
14873862f8
Q/A history 2026-01-12 12:36:29 +02:00
Yiorgis Gozadinos
5a1cb253e5
Message history 2026-01-12 12:36:29 +02:00
Yiorgis Gozadinos
9f1d82daa8
Citations 2026-01-12 12:36:29 +02:00
Yiorgis Gozadinos
f8964f6efc
Basic frontend 2026-01-12 12:36:28 +02:00
Yiorgis Gozadinos
050ea8df70
Basic backend for app 2026-01-12 12:36:28 +02:00
Yiorgis Gozadinos
747acd6f6a
vb 2026-01-12 12:08:28 +02:00
Yiorgis Gozadinos
061095e855
Remove obsolete migrations 2026-01-12 12:07:49 +02:00
Yiorgis Gozadinos
119ca84da8
Merge pull request #227 from ggozad/feat/docling-doc-compression
Fix large storage overflow by changing docling_document_json (str) to docling_document (compressed bytes)
2026-01-12 11:57:31 +02:00
Yiorgis Gozadinos
29c682d8eb
Add migration 2026-01-11 11:40:57 +02:00
Yiorgis Gozadinos
9c4fd08c47
Update client serialization for compressed docling documents 2026-01-11 09:23:56 +02:00
Yiorgis Gozadinos
be715dd456
Revert docling core back to 1.8.0 for compatibility with docling-serve 2026-01-11 09:23:19 +02:00
Yiorgis Gozadinos
afc5b02285
Update schema to store docling_document as compressed bytes
- Change DocumentRecord.docling_document_json (str) to docling_document (bytes)
- Use large_binary Arrow type (64-bit offsets) to avoid 2GB column limit
- Decompress in Document.get_docling_document() using gzip
- Update DocumentRepository field mappings
2026-01-10 15:17:27 +02:00
Yiorgis Gozadinos
face6f95bc
compression utils 2026-01-10 15:11:58 +02:00
Yiorgis Gozadinos
09acc845c0
Update docling, docling-core, lancedb deps 2026-01-10 15:06:56 +02:00
Yiorgis Gozadinos
ff1f19bb08
vb 2026-01-08 18:50:39 +02:00