581ddf4f41
Vacuum compacts documents and document_items through lance directly with a fragment target derived from storage.compaction_target_bytes (default 2 GiB), instead of AsyncTable.optimize, whose default 1,048,576-row fragment target re-merges the whole table on every pass and peaks at 5-6x the table's bytes. The target is sized from the widest fragment's bytes per row, so peak memory is bounded by the target instead of the corpus. lancedb's async API exposes no compaction options (lancedb/lancedb#2325), hence the pylance dependency.
46 lines
751 B
Text
46 lines
751 B
Text
# Python-generated files
|
|
__pycache__/
|
|
*.py[oc]
|
|
build/
|
|
dist/
|
|
wheels/
|
|
*.egg-info
|
|
**/.DS_Store
|
|
|
|
# Virtual environments
|
|
.venv
|
|
|
|
# tests
|
|
.coverage*
|
|
evaluations/evaluations/data/
|
|
evaluations/scripts/*
|
|
!evaluations/scripts/build_t2_submission.py
|
|
tests/data/
|
|
.pytest_cache/
|
|
.ruff_cache/
|
|
|
|
# environment variables and config files
|
|
.env
|
|
haiku.rag.yaml
|
|
TODO.md
|
|
PLAN.md
|
|
DEVNOTES.md
|
|
|
|
# mcp registry
|
|
.mcpregistry_github_token
|
|
.mcpregistry_registry_token
|
|
|
|
# zensical site directory when doing local docs builds
|
|
site/
|
|
|
|
# Claude Code personal notes
|
|
.claude.local.md
|
|
|
|
# Publish shared Claude skills, keep local Claude settings private
|
|
!.claude/
|
|
.claude/*
|
|
!.claude/skills/
|
|
!.claude/skills/**
|
|
|
|
# Vacuum investigation scratch: kept on disk, never committed
|
|
vacuum-findings/
|