haiku.rag/haiku_rag_slim/haiku
Chris McDonough a6b3e7f1f6 Stagger periodic poll sweeps to avoid thundering herd
All pollers sharing the same poll_interval_s previously woke up and
swept at exactly the same moment after startup. With 10+ sources
this causes a coordinated spike in listing traffic (S3 LIST, WebDAV
PROPFIND, HTTP HEAD) every interval.

Add a random initial delay of 0-25% of the poll interval after the
first sweep, applied to both PeriodicPoller and FSPoller's sweep
loop. Subsequent sweeps run on the normal fixed interval, now
staggered across sources.
2026-06-01 07:02:42 -04:00
..
rag Stagger periodic poll sweeps to avoid thundering herd 2026-06-01 07:02:42 -04:00