From dcb30df225ea97a4065c95fc12de402908fc07a1 Mon Sep 17 00:00:00 2001 From: Donald Buczek Date: Tue, 3 Jan 2023 10:19:00 +0100 Subject: [PATCH 1/2] slowio: Set memory to 4GB on ellie proxmox-backup on ellie dies with oom when doing backup of WINHYPE-c: journalctl -u proxmox-backup [...] Jan 03 04:59:32 ellie.molgen.mpg.de slowio[22061]: proxmox-backup-client backup --keyfile /etc/mxproxmox/proxmox-backup.key --backup-id acrb_winhype-c acrb_winhype-c.pxar:/amd/ellie/M/M8041/project/acrbkps/Tmp/WINHYPE-c Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Starting backup: host/acrb_winhype-c/2023-01-03T03:59:33Z Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Client name: ellie Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Starting backup protocol: Tue Jan 3 04:59:33 2023 Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Using encryption key from '/etc/mxproxmox/proxmox-backup.key'.. Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Encryption key fingerprint: 56:22:1b:83:ed:ce:32:d8 Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Downloading previous manifest (Sat Dec 24 11:57:49 2022) Jan 03 04:59:33 ellie.molgen.mpg.de slowio[22061]: Upload directory '/amd/ellie/M/M8041/project/acrbkps/Tmp/WINHYPE-c' to 'mariux64@pbs!backup@nummer5.molgen.mpg.de:8007:zpool2' as acrb_winhype-c.pxar.didx Jan 03 07:10:58 ellie.molgen.mpg.de systemd[1]: proxmox-backup.service: Main process exited, code=exited, status=1/FAILURE Jan 03 07:10:58 ellie.molgen.mpg.de systemd[1]: proxmox-backup.service: Failed with result 'exit-code'. Jan 03 07:10:58 ellie.molgen.mpg.de systemd[1]: proxmox-backup.service: Consumed 4h 21min 46.123s CPU time. dmesg [...] [ +0.137690] Tasks state (memory values in pages): [ +0.006148] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ +0.010545] [ 22061] 0 22061 11291 6615 110592 0 0 mxproxmox [ +0.010464] [ 22065] 0 22065 701421 476627 4034560 0 0 proxmox-backup- [ +0.011050] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=/,mems_allowed=0-1,oom_memcg=/slowio.slice,task_memcg=/slowio.slice/proxmox-backup.service,task=proxmox-backup-,pid=22065,uid=0 [ +0.021632] Memory cgroup out of memory: Killed process 22065 (proxmox-backup-) total-vm:2805684kB, anon-rss:1893656kB, file-rss:12852kB, shmem-rss:0kB, UID:0 pgtables:3940kB oom_score_adj:0 Change slowio memory size from default 2GB to 4GB on ellie. --- slowio/slowio-mem-control | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/slowio/slowio-mem-control b/slowio/slowio-mem-control index c14108c..043bd4d 100755 --- a/slowio/slowio-mem-control +++ b/slowio/slowio-mem-control @@ -1,7 +1,7 @@ #! /usr/bin/bash case "$(hostname -s)" in - ex|pummelfee|snugglebites|bloodwing|tldr) + ex|pummelfee|snugglebites|bloodwing|tldr|ellie) mkdir -p "$1/slowio.slice.d" cat > "$1/slowio.slice.d/dynamic_memory.conf" <<- '_EOF_' [Slice] From cda9d8e96c4e367066a6f7ef7b70b42eee8266eb Mon Sep 17 00:00:00 2001 From: Donald Buczek Date: Tue, 3 Jan 2023 10:33:00 +0100 Subject: [PATCH 2/2] slowio: Set memory to 4GB on icebear proxmox-backup on icebear runs into oom, too, for /home/rahn. No idea why, but increase memory anyway. --- slowio/slowio-mem-control | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/slowio/slowio-mem-control b/slowio/slowio-mem-control index 043bd4d..05fafea 100755 --- a/slowio/slowio-mem-control +++ b/slowio/slowio-mem-control @@ -1,7 +1,7 @@ #! /usr/bin/bash case "$(hostname -s)" in - ex|pummelfee|snugglebites|bloodwing|tldr|ellie) + ex|pummelfee|snugglebites|bloodwing|tldr|ellie|icebear) mkdir -p "$1/slowio.slice.d" cat > "$1/slowio.slice.d/dynamic_memory.conf" <<- '_EOF_' [Slice]