danvics/haiku.rag
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
haiku.rag/tests/ingester
History
Yiorgis Gozadinos 44089e5b1f
Support a dburi for the ingester queue (SQLite + Postgres) 
Migrate the ingester queue storage from raw aiosqlite to SQLAlchemy Core
async. The backend is chosen by ingester.queue.dburi: a SQLAlchemy async
URL points the queue at a database server, and SQLite remains the default
when unset. The Postgres path claims jobs with FOR UPDATE SKIP LOCKED so
multiple ingester processes can share one queue; SQLite caps the pool to a
single connection to keep the select-then-update claim atomic.
2026-06-03 14:34:09 +03:00
..
__init__.py ingester: add source-adapter scaffolding + FS source 2026-05-26 11:41:53 +03:00
conftest.py Support a dburi for the ingester queue (SQLite + Postgres) 2026-06-03 14:34:09 +03:00
test_api.py Support a dburi for the ingester queue (SQLite + Postgres) 2026-06-03 14:34:09 +03:00
test_circuit_breaker.py additional config, pollers, serve 2026-05-26 11:41:54 +03:00
test_cli.py Strengthen config-load assertions 2026-06-01 18:03:09 +03:00
test_config.py Collapse worker_count and max_concurrent into worker_count 2026-05-27 12:48:14 +03:00
test_filter.py Improve test coverage for cli, filter, registry, and migrations 2026-06-01 18:00:47 +03:00
test_fs_source.py Add configurable max_file_size to reject oversized files before ingestion 2026-06-01 18:40:46 +03:00
test_http_source.py Add configurable max_file_size to reject oversized files before ingestion 2026-06-01 18:40:46 +03:00
test_pipeline.py skip spurious ingester DELETE when the resource is back on its source 2026-06-03 14:05:53 +03:00
test_pollers.py Support a dburi for the ingester queue (SQLite + Postgres) 2026-06-03 14:34:09 +03:00
test_queue.py Support a dburi for the ingester queue (SQLite + Postgres) 2026-06-03 14:34:09 +03:00
test_resolve_fetcher.py Improve test coverage for cli, filter, registry, and migrations 2026-06-01 18:00:47 +03:00
test_revision_round_trip.py record cassettes against new fixtures, fix stale assertions 2026-05-26 11:44:46 +03:00
test_run_batch.py Merge pull request #405 from mcdonc/fix/run-batch-hang-on-dead-workers 2026-06-01 17:51:49 +03:00
test_s3_source.py Add configurable max_file_size to reject oversized files before ingestion 2026-06-01 18:40:46 +03:00
test_serve_integration.py Support a dburi for the ingester queue (SQLite + Postgres) 2026-06-03 14:34:09 +03:00
test_sources_base.py Fix shutdown-order bug: close source clients after workers stop 2026-06-01 09:55:39 -04:00
test_webdav_source.py Add configurable max_file_size to reject oversized files before ingestion 2026-06-01 18:40:46 +03:00
test_workers.py Support a dburi for the ingester queue (SQLite + Postgres) 2026-06-03 14:34:09 +03:00