Chris McDonough 7e4aa8c71f Add configurable max_file_size to reject oversized files before ingestion ... Large files buffered entirely in RAM can OOM workers. Add max_file_size to source config (default None = no limit). FS checks stat().st_size before read_bytes(). HTTP and WebDAV issue a HEAD request before GET when a limit is configured. S3 checks the size from the existing head_async() call before get_async(). FileTooLargeError is classified as PermanentError so oversized files go straight to the DLQ instead of retrying.		2026-06-01 18:40:46 +03:00
..
__init__.py	worker pool, rety policy, pipeline	2026-05-26 11:41:54 +03:00
pipeline.py	Add configurable max_file_size to reject oversized files before ingestion	2026-06-01 18:40:46 +03:00
pool.py	Merge pull request #409 from mcdonc/fix/sync-state-write-crash	2026-06-01 17:46:46 +03:00
retry.py	Backfill ingester test gaps and drop unneeded retry clamp	2026-05-27 14:24:22 +03:00