Commit graph

20 commits

Author SHA1 Message Date
Yiorgis Gozadinos
581ddf4f41
Bound vacuum compaction memory on the tables holding docling blobs
Vacuum compacts documents and document_items through lance directly
with a fragment target derived from storage.compaction_target_bytes
(default 2 GiB), instead of AsyncTable.optimize, whose default
1,048,576-row fragment target re-merges the whole table on every pass
and peaks at 5-6x the table's bytes. The target is sized from the
widest fragment's bytes per row, so peak memory is bounded by the
target instead of the corpus. lancedb's async API exposes no
compaction options (lancedb/lancedb#2325), hence the pylance
dependency.
2026-09-04 10:35:26 +03:00
Yiorgis Gozadinos
271fdf9b5a
Add Logfire debugging skills and worker-breaker event 2026-07-10 13:23:17 +03:00
Yiorgis Gozadinos
0c33a00b4e
claude code personal notes 2026-06-16 17:06:32 +03:00
Yiorgis Gozadinos
e9bd56467c
Add T²-RAGBench leaderboard submission exporter 2026-06-08 11:51:02 +03:00
Yiorgis Gozadinos
b7f542b148
fix README links and stale MkDocs reference 2026-05-20 17:00:40 +03:00
Yiorgis Gozadinos
704bea6f4a
Stabilize test_client_search ranking assertion 2026-05-14 14:37:27 +03:00
Yiorgis Gozadinos
343272d6fb
Chunkers return chunks with metadata, i.e. (refs, labels, headings, page_numbers) 2025-12-08 15:54:31 +02:00
Yiorgis Gozadinos
2f9c907031
Restructure into uv workspace to support minimal and full installations 2025-11-04 17:59:12 +02:00
Yiorgis Gozadinos
0fbe8cc516
Update documentation 2025-10-23 11:58:47 +03:00
Mikko Ohtamaa
623b234346
Polish tutorial 2025-10-20 19:11:40 +03:00
Yiorgis Gozadinos
c9fc0cd750
MCP server registry 2025-10-08 11:10:54 +03:00
Yiorgis Gozadinos
43b9cd50ba
Move evaluations to src/ 2025-09-30 13:21:53 +03:00
Yiorgis Gozadinos
6a1d7b3fa9
Ignore tests/data where we store the qa corpus 2025-09-30 11:42:28 +03:00
Yiorgis Gozadinos
57e86d00fd
Refactor evaluations so that we can perform with multiple datasets..
Introduce Wix dataset.
2025-09-30 11:31:50 +03:00
Yiorgis Gozadinos
f7fc2db288
Ignore devnotes 2025-09-17 08:51:42 +03:00
Yiorgis Gozadinos
b462a9f09b
Ignore todo list 2025-09-05 11:41:41 +03:00
Yiorgis Gozadinos
a1079fd1f5
VoyageAI embeddings 2025-06-18 09:45:36 +02:00
Yiorgis Gozadinos
88b02ece3e
test coverage 2025-06-16 17:32:00 +02:00
Yiorgis Gozadinos
6c948a4afd
Chucker & tests 2025-06-15 21:08:06 +02:00
Yiorgis Gozadinos
fb7b97dd75
init repo 2025-06-15 13:21:17 +02:00