ibizaman
2e253267db
tests: replace deprecated copy_from_vm function
2026-06-20 13:18:18 +02:00
Dmitry
508bc9844c
Add eval-only test for Let's Encrypt DNS provider configuration
2026-06-18 12:49:08 +02:00
Dmitry
24fdbb81df
Fix Open WebUI tests in offline mode
...
Open WebUI 0.9.6 still initializes its embedding function during startup, even when OFFLINE_MODE=true and BYPASS_EMBEDDING_AND_RETRIEVAL=true. With OFFLINE_MODE=true and no cached SentenceTransformer model, startup failed with:
ValueError: No embedding model is loaded. Set RAG_EMBEDDING_MODEL to a valid SentenceTransformer model name, or configure an external RAG_EMBEDDING_ENGINE (ollama, openai, azure_openai).
Configure the tests to use a dummy Ollama embedding endpoint so startup does not try to load or download a local embedding model. The endpoint is not meant to be contacted by these tests; it only keeps startup on the external embedding configuration path.
2026-06-17 12:50:57 +02:00
Dmitry
2a57f335f2
Cap deluged restarts at 2
...
`StartLimit` does not exactly cap the number of retries; instead, it specifies a window at the beginning of the service lifespan when the number of retries is capped.
Also assert later that the number of restarts is at most 1.
2026-06-14 18:37:08 +02:00
Dmitry
f4f4881310
Restart deluged on failure in tests
...
Running
```sh
nix build .#checks.x86_64-linux.vm_deluge_sso --max-jobs 1 --cores 1
```
`deluged` sometimes segfaults: https://gist.github.com/dniku/5056689d9191e839e39d4c7b3fbf6410
Fixing this does not seem in scope for SHB.
2026-06-14 18:37:08 +02:00
Dmitry
60dfb9d19b
Extract Jellyfin test extraScript into commonExtraScript and prepend it in LDAP test
...
`commonTestScript.access.override` replaces the full extraScript, and in particular drops:
```
server.wait_until_succeeds("journalctl --since -1m --unit jellyfin --grep 'Startup complete'")
```
https://github.com/ibizaman/selfhostblocks/actions/runs/27462763816/job/81262609484?pr=731 shows the symptoms:
* https://github.com/ibizaman/selfhostblocks/actions/runs/27462763816/job/81262609484?pr=731#step:5:7163 logs `Login from client` (defined in 8871b9435b/test/common.nix (L166) ) at timestamp `2026-06-14T08:34:06.7507323Z` (visible in the raw logs)
* https://github.com/ibizaman/selfhostblocks/actions/runs/27462763816/job/81262609484?pr=731#step:5:7167 is the first request from Firefox at timestamp 2026-06-14T08:34:18.2868336Z, so the attempt to fill in the username starts around there, with a 30-second timeout
* https://github.com/ibizaman/selfhostblocks/actions/runs/27462763816/job/81262609484?pr=731#step:5:7577 logs `Main: Startup complete 0:01:00.1813498` at timestamp 2026-06-14T08:34:51.1325282Z, 45 seconds after test starts
Work around by explicitly prepending the full extraScript to the override.
2026-06-14 16:21:49 +02:00
Dmitry
8871b9435b
grafana: fix tests to use API for checking user login ( #725 )
2026-06-07 13:11:26 +02:00
Dmitry
669d4bf1b7
test(open-webui): assert SSO session instead of login toast
...
Open WebUI redirects from /auth to / after OIDC login and briefly shows the "You're now logged in" toast during that transition. The toast is not a stable post-login signal, so the VM test can fail even though SSO succeeded.
Wait for the final root URL and verify the authenticated Open WebUI session through /api/v1/auths/ instead. This keeps the test focused on the expected SSO outcome while avoiding the transient UI race.
2026-06-05 09:28:29 +02:00
ibizaman
066ff81def
scrutiny: use correct assert in tests
2026-06-04 00:47:53 +02:00
ibizaman
81c32c75d5
scrutiny: remove click in test
2026-06-04 00:47:53 +02:00
ibizaman
8dcb2af682
scrutiny: increase delays in tests
2026-06-04 00:47:53 +02:00
ibizaman
1fa0781f09
authelia: admin defeat and comment out failing tests for now
2026-06-04 00:47:53 +02:00
ibizaman
5bfd1c4008
open-webui: increase test timeouts
2026-06-04 00:47:53 +02:00
ibizaman
9736456153
open-webui: update assert in test after wording change
2026-06-04 00:47:53 +02:00
ibizaman
aa290b517c
mailserver: use same casing for passwords as for other tests
2026-06-04 00:47:53 +02:00
ibizaman
1a056b4c23
tests: use correct casing in tests
2026-06-04 00:47:53 +02:00
ibizaman
4bb9287aa4
home-assistant: fix login test
2026-06-04 00:47:53 +02:00
ibizaman
2c23d8a258
tests: keep trace even on failure
2026-06-04 00:47:53 +02:00
ibizaman
337f3ec8bc
tests: fail tests if playwright cannot login
2026-06-04 00:47:53 +02:00
ibizaman
941f2257d0
zfs: allow snapshot before activation
2026-05-26 22:25:53 +02:00
ibizaman
db0b5df83d
fluentbit: fix unit startup
2026-05-24 11:19:38 +02:00
ibizaman
503f1c31ea
mailserver: update to e33fbde and add test
2026-05-24 01:37:52 +02:00
ibizaman
c7e404f8be
tests: use hardcodedsecret for lldap secrets
2026-05-24 01:37:52 +02:00
ibizaman
ec3406039d
open-webui: increase memory for open-webui test
2026-05-11 01:27:27 +02:00
ibizaman
23d3a59172
authelia: update test now that authelia forbids http
2026-05-11 01:27:27 +02:00
ibizaman
7ca1f93f3f
datasetBackup: add contract with sanoid implementation
2026-04-27 06:38:52 +02:00
ibizaman
a0d29e9d97
backup: enhance restore script and more tests
2026-04-26 23:17:28 +02:00
ibizaman
bdd8a0cc2a
zfs: add doc and tests and convert to systemd services
2026-04-26 22:19:53 +02:00
ibizaman
96a8753548
backup: do not make systemd service wait for backup to complete
...
fixes #421
2026-04-26 21:40:48 +02:00
ibizaman
968e54dd89
deluge: refactor to fix test
2026-03-31 23:19:33 +02:00
ibizaman
f0124a4615
ssl: make self-signed certs idempotent
2026-03-15 15:57:00 +01:00
ibizaman
0dc2406b6a
scrutiny: init
2026-03-12 23:24:41 +01:00
ibizaman
c7cf3cce13
monitoring: contact points is now always needed it seems
2026-03-12 20:43:43 +01:00
ibizaman
7611e99eaa
nextcloud: disable tests for apps not supporting 33
2026-03-12 20:43:43 +01:00
ibizaman
c333122720
nextcloud: bump to 32 and 33
2026-03-12 20:43:43 +01:00
ibizaman
c0c9562789
forgejo: make sure ldap is setup when sso is enabled
2026-02-26 22:40:23 +01:00
ibizaman
f485cc60fe
homepage: init with dashboard contract
2026-02-24 20:00:36 +01:00
ibizaman
0d2a7c315f
arr: add declarative api key
2026-02-24 20:00:36 +01:00
sitrius
5da47a77c7
fix: use configurable dataDir paths in arr stack and fix sops.secret references
...
- Replace hardcoded /var/lib/<app> paths with shb.arr.<app>.dataDir in arr.nix
- Fix bazarr config path in test to use cfg.dataDir
- Correct shb.sops.secrets → shb.sops.secret in documentation files
2026-02-22 10:04:13 +01:00
ibizaman
aeff324fcf
jellyfin: update jellyfin cli for 10.11.6
2026-02-02 08:14:21 +01:00
ibizaman
f39f0bd9bf
mitmdump: use systemd-python after systemd got deprecated
2026-02-02 08:14:21 +01:00
ibizaman
6ebd3204c9
nit: use shb nixos tester
...
The pkgs.nixosTest has been deprecated
2026-02-02 08:14:21 +01:00
ibizaman
7b58458270
nit: run linter after update
2026-02-02 08:14:21 +01:00
ibizaman
cac0a5fbf9
nextcloud: accept users only part of the admin group
2026-01-12 09:50:31 +01:00
ibizaman
d3e2834604
pinchflat: remove test for unsupported admin only user
2026-01-12 09:50:31 +01:00
ibizaman
8ad4385ad8
karakeep: remove test for unsupported admin only user
2026-01-12 09:50:31 +01:00
ibizaman
896246a187
forgejo: accept users only part of the admin group
2026-01-12 09:50:31 +01:00
ibizaman
38d8f3034e
open-webui: speed up test by enabling offline mode
2026-01-12 09:50:31 +01:00
ibizaman
4d7c5844a8
ldap: make sure admin user can log in too
2026-01-12 09:50:31 +01:00
ibizaman
a584decd52
nextcloud: test for all supported versions
2026-01-11 23:16:55 +01:00