Yiorgis Gozadinos
d781335868
Move CircuitBreaker to a shared module
...
Relocate CircuitBreaker from ingester/pollers to haiku/rag/circuit_breaker
so non-ingester callers (docling-serve provider) can reuse it without
depending on the ingester package.
Co-Authored-By: bryan davis <bryan@monkeytronics.org>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-08 11:03:30 +03:00
Yiorgis Gozadinos
d71695833d
Merge pull request #485 from ggozad/fix/update-uri
...
Allow updating a document's uri via update_document
2026-07-08 10:41:24 +03:00
Yiorgis Gozadinos
c2c8c24951
Allow updating a document's uri via update_document
2026-07-08 10:32:14 +03:00
Yiorgis Gozadinos
d84147511a
Drop broken type=gha cache from Docker slim publish
2026-07-03 20:32:51 +03:00
Yiorgis Gozadinos
9a9bea86d3
vb
2026-07-03 13:35:10 +03:00
Yiorgis Gozadinos
8f3cf70eb2
Merge pull request #482 from ggozad/fix/attach-picture-from-caption
...
Attach figure bytes when a result matches its caption
2026-07-03 13:32:17 +03:00
Yiorgis Gozadinos
d2593304c5
Attach figure bytes when a result matches its caption
2026-07-03 13:22:02 +03:00
Yiorgis Gozadinos
07098d55e4
Merge pull request #481 from ggozad/chore/clean-up
...
Clean up reranker/converter/embedder layers and cut test runtime
2026-06-29 15:26:07 +03:00
Yiorgis Gozadinos
7f50d3698f
Validate reranker config before importing the provider package
2026-06-29 15:15:26 +03:00
Yiorgis Gozadinos
ac64aa9c17
Build the skills rag_db fixture once per session
2026-06-29 15:15:26 +03:00
Yiorgis Gozadinos
e4b1f16f97
Shrink the docling-serve context-expansion cassette
2026-06-29 15:15:26 +03:00
Yiorgis Gozadinos
afd6e3ae00
Share the VLM URL builder and centralize the embedder empty guard
2026-06-29 15:15:26 +03:00
Yiorgis Gozadinos
654cb2b94c
Collapse get_reranker into a single guard and import-guarded dispatch
...
Replace the seven repeated `config.reranking.model and ... == provider`
checks and six per-branch ImportError handlers with one None guard and one
try/except around the provider dispatch.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-29 15:15:26 +03:00
Yiorgis Gozadinos
38079ff89a
Hoist reranker empty-input guard into base; stop factory tests loading models
2026-06-29 14:20:23 +03:00
Yiorgis Gozadinos
9a85632cf3
vb
2026-06-29 12:36:36 +03:00
Yiorgis Gozadinos
325f4517ba
Update t2_finqa config
2026-06-29 12:22:58 +03:00
Yiorgis Gozadinos
5fc4056dcd
Require haiku.skills>=0.18.0
2026-06-29 11:44:51 +03:00
Yiorgis Gozadinos
3cb229d2e0
Add t2_finqa pre-built evaluation database reference config and docs
2026-06-29 10:52:23 +03:00
Yiorgis Gozadinos
38c62521d8
Merge pull request #480 from ggozad/chore/orb-nemotron-upload
...
Add nemotron-vl multimodal eval database and pre-built DB reference configs
2026-06-29 10:26:00 +03:00
Yiorgis Gozadinos
4d03b1e669
Add nemotron-vl multimodal eval database and reference configs
2026-06-29 10:14:53 +03:00
Yiorgis Gozadinos
b2abdfaffb
vb
2026-06-28 10:57:26 +03:00
Yiorgis Gozadinos
b707dfe848
Merge pull request #479 from ggozad/feat/speed-up-duplicates
...
Speed up doctor's duplicate-document detection
2026-06-28 10:51:32 +03:00
Yiorgis Gozadinos
4f8cc4eb30
Show a progress spinner while doctor runs
2026-06-28 10:44:30 +03:00
Yiorgis Gozadinos
b707a70d19
Update docs
2026-06-28 10:24:12 +03:00
Yiorgis Gozadinos
e7b4988d82
Compute document centroids during the vector scan
2026-06-28 10:23:16 +03:00
Yiorgis Gozadinos
15aae0f242
Simplify duplicate detection to whole-document centroid similarity
2026-06-28 10:23:16 +03:00
Yiorgis Gozadinos
c7c3f75508
vb
2026-06-27 09:59:21 +03:00
Yiorgis Gozadinos
bd520cb995
Merge pull request #477 from ggozad/fix/limit-context-blowing-expansion
...
Hard-cap context expansion at max_context_chars
2026-06-27 09:58:25 +03:00
Yiorgis Gozadinos
b94e13083f
Hard-cap context expansion at max_context_chars
...
A single oversized document_items row (e.g. a spreadsheet converted to one
table) expanded far past search.max_context_chars and could overflow the
model context window. _expand_outward only used the budget as a soft
accumulation threshold and expand_with_items never capped the joined result.
Add _clip_to_budget to clip each expanded result to max_context_chars,
returning a window centered on the matched chunk (via _evidence_anchors) so
the retrieved evidence survives the cut.
2026-06-27 09:46:36 +03:00
Yiorgis Gozadinos
cd1a73b389
vb
2026-06-26 17:13:03 +03:00
Yiorgis Gozadinos
7cdf93e23a
Merge pull request #475 from ggozad/feat/document-similarity
...
Detect near-duplicate documents in `doctor`
2026-06-26 17:05:33 +03:00
Yiorgis Gozadinos
73f62ab290
Enforce the duplicate candidate cap during row collection
2026-06-26 16:57:51 +03:00
Yiorgis Gozadinos
f1e1a16f9b
Add doctor --duplicates-out YAML export; summarize terminal report
2026-06-26 16:52:22 +03:00
Yiorgis Gozadinos
044ac62e49
Drop boilerplate handling; make duplicate report readable
2026-06-26 16:52:22 +03:00
Yiorgis Gozadinos
961913dde4
Ignore boilerplate chunks in duplicate-document detection
2026-06-26 16:52:21 +03:00
Yiorgis Gozadinos
43f2130b66
Add near-duplicate document detection to doctor
2026-06-26 16:52:21 +03:00
Yiorgis Gozadinos
ce27a7aae5
Clean up S3 test data per-test to keep SeaweedFS writable
2026-06-26 16:41:20 +03:00
Yiorgis Gozadinos
98f2a088d8
Merge pull request #474 from ggozad/chore/dependabot-alerts
...
Security dependency updates
2026-06-26 15:28:49 +03:00
Yiorgis Gozadinos
1969c4528e
Fix example app
2026-06-26 13:12:53 +03:00
Yiorgis Gozadinos
5463a07d32
chore(deps): patch Dependabot security alerts
2026-06-26 10:55:26 +03:00
Yiorgis Gozadinos
9f45addbe9
Merge pull request #470 from ggozad/fix/dangling-workers
...
Lease-renewal reaping for ingester workers
2026-06-26 09:19:43 +03:00
Yiorgis Gozadinos
87f0233bcd
Cover heartbeat health, lease-renewal failure, and breaker recovery
2026-06-25 16:32:56 +03:00
Yiorgis Gozadinos
4333ab4fe2
Document lease-based ingester reaping
2026-06-25 13:28:25 +03:00
Yiorgis Gozadinos
4707db780f
Renew job leases from the worker pool; lease-based reaping
2026-06-25 13:26:09 +03:00
Yiorgis Gozadinos
fd73f57649
Add last_heartbeat_at lease column to the ingester queue
2026-06-25 13:25:37 +03:00
Yiorgis Gozadinos
ba6b318ece
Make ingester worker ids globally unique
2026-06-25 13:25:37 +03:00
Yiorgis Gozadinos
6bbf12e794
Merge pull request #469 from ggozad/fix/minor-issues
...
Minor config and FTS-index fixes
2026-06-25 13:21:00 +03:00
Yiorgis Gozadinos
b61134b747
Log FTS index build failures at WARNING
2026-06-25 13:00:29 +03:00
Yiorgis Gozadinos
2fd025951c
Treat empty env vars as unset in config expansion
2026-06-25 12:41:04 +03:00
Yiorgis Gozadinos
73beae5a4c
Harden MCP publisher install and bump action versions
2026-06-24 19:38:50 +03:00
