danvics/haiku.rag
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
haiku.rag/haiku_rag_slim/haiku/rag
History
Yiorgis Gozadinos 581ddf4f41
Bound vacuum compaction memory on the tables holding docling blobs 
Vacuum compacts documents and document_items through lance directly
with a fragment target derived from storage.compaction_target_bytes
(default 2 GiB), instead of AsyncTable.optimize, whose default
1,048,576-row fragment target re-merges the whole table on every pass
and peaks at 5-6x the table's bytes. The target is sized from the
widest fragment's bytes per row, so peak memory is bounded by the
target instead of the corpus. lancedb's async API exposes no
compaction options (lancedb/lancedb#2325), hence the pylance
dependency.
2026-09-04 10:35:26 +03:00
..
capabilities Remove the environment overrides and the last unnamed-database wording 2026-09-03 15:12:09 +03:00
chat Remove the environment overrides and the last unnamed-database wording 2026-09-03 15:12:09 +03:00
chunkers Delete comments that restate the line below them 2026-08-20 15:22:33 +03:00
client Fix missing timezone info on ingested docs. mcp schema requires TZ 2026-09-03 17:48:01 +03:00
config Bound vacuum compaction memory on the tables holding docling blobs 2026-09-04 10:35:26 +03:00
converters Add per-endpoint api_key to model and embedding config 2026-08-23 23:54:40 +03:00
embeddings Accept a /v1 suffix on the vLLM reranker base_url 2026-08-28 15:46:42 +03:00
ingester Report a stemless --db path as a usage error and separate the two lancedb.uri migrations 2026-09-03 15:12:09 +03:00
inspector Hand storage the database location, not the configuration that placed it 2026-09-03 15:11:37 +03:00
providers Wire providers.docling_serve.timeout through to the client 2026-08-19 13:30:45 +03:00
reranking Accept a /v1 suffix on the vLLM reranker base_url 2026-08-28 15:46:42 +03:00
sandbox Finish the comment pass, and escape document fields everywhere Rich renders 2026-08-28 15:34:47 +03:00
sources Resolve file:// URIs to paths through url2pathname 2026-08-21 10:22:26 +03:00
store Bound vacuum compaction memory on the tables holding docling blobs 2026-09-04 10:35:26 +03:00
tools Deduplicate search results within one model response 2026-09-02 12:29:12 +03:00
__init__.py Restructure into uv workspace to support minimal and full installations 2025-11-04 17:59:12 +02:00
app.py One reference and one placement for a database 2026-09-03 15:12:08 +03:00
circuit_breaker.py Move CircuitBreaker to a shared module 2026-07-08 11:03:30 +03:00
cli.py Report a stemless --db path as a usage error and separate the two lancedb.uri migrations 2026-09-03 15:12:09 +03:00
context.py Ask and analyze across several databases 2026-08-24 10:03:46 +03:00
doctor.py Hand storage the database location, not the configuration that placed it 2026-09-03 15:11:37 +03:00
logging.py Delete comments that restate the line below them 2026-08-20 15:22:33 +03:00
mcp.py One reference and one placement for a database 2026-09-03 15:12:08 +03:00
s3.py swap aioboto3 for obstore in the S3 client path 2026-05-11 11:29:42 +03:00
telemetry.py Route eval scripts through the shared telemetry configure 2026-07-10 11:38:33 +03:00
uri.py Resolve file:// URIs to paths through url2pathname 2026-08-21 10:22:26 +03:00
utils.py One reference and one placement for a database 2026-09-03 15:12:08 +03:00