Another crash on the same autoscaler instance:
2022-11-04 15:53:54 2022-11-04 14:53:50,393 - usage_reporter - INFO - Sending usage report for 60 usage seconds, 1 units 2022-11-04 14:53:51,092 - clearml.Auto-Scaler - INFO - 2415066998557416558 console log: Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd[1]: var-lib-docker-overlay2-b04bca4c99cf94c31a3644236d70727aaa417fa4122e1b6c012e0ad908af24ef\x2dinit-merged.mount: Deactivated successfully. Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.357552] docker0: port 1(vetha6fafde) entered blocking state Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.357557] docker0: port 1(vetha6fafde) entered disabled state Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.357708] device vetha6fafde entered promiscuous mode Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd-networkd[470]: vetha6fafde: Link UP Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd-udevd[7712]: Using default interface naming scheme 'v249'. Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd-udevd[7714]: Using default interface naming scheme 'v249'. Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b networkd-dispatcher[618]: WARNING:Unknown index 6 seen, reloading interface list Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b containerd[4030]: time="2022-11-04T14:53:29.995721256Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1 Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b containerd[4030]: time="2022-11-04T14:53:29.995779219Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1 Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b containerd[4030]: time="2022-11-04T14:53:29.995788130Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1 Nov 4 14:53:29 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b containerd[4030]: time="2022-11-04T14:53:29.995942417Z" level=info msg="starting signal loop" namespace=moby path=/run/containerd/io.containerd.runtime.v2.task/moby/38ba08db210d005bf36348dc4702ba54b068dd16054fb47248b8e3d8e34da95e pid=7737 runtime=io.containerd.runc.v2 [ OK ] Started libcontainer conta…8dd16054fb47248b8e3d8e34da95e. Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd[1]: Started libcontainer container 38ba08db210d005bf36348dc4702ba54b068dd16054fb47248b8e3d8e34da95e. Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.590266] eth0: renamed from veth79464f9 Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd-networkd[470]: vetha6fafde: Gained carrier Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd-networkd[470]: docker0: Gained carrier Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.610001] IPv6: ADDRCONF(NETDEV_CHANGE): vetha6fafde: link becomes ready Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.610041] docker0: port 1(vetha6fafde) entered blocking state Nov 4 14:53:30 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b kernel: [ 1245.610044] docker0: port 1(vetha6fafde) entered forwarding state Nov 4 14:53:31 clearml-worker-9357f6985dcc4f3c9d44b32a9ac2e09b systemd-networkd[470]: vetha6fafde: Gained IPv6LL 2022-11-04 15:53:59 2022-11-04 14:53:58,099 - clearml.Auto-Scaler - INFO - monitor_spots: 4423912289108270944 is alive 2022-11-04 14:53:58,309 - clearml.Auto-Scaler - INFO - monitor_spots: 2415066998557416558 is alive 2022-11-04 15:54:44 2022-11-04 14:54:43,724 - clearml.Auto-Scaler - INFO - Found 0 tasks in queue 'Quad_VCPU_16GB' 2022-11-04 14:54:43,901 - clearml.Auto-Scaler - INFO - --- Cloud instances (2) --- 2022-11-04 14:54:43,901 - clearml.Auto-Scaler - INFO - gcp4cpu, 2415066998557416558, regular 2022-11-04 14:54:43,901 - clearml.Auto-Scaler - INFO - gcp4cpu, 4423912289108270944, regular 2022-11-04 14:54:43,998 - clearml.Auto-Scaler - INFO - Idle for 60.00 seconds 2022-11-04 15:54:54 2022-11-04 14:54:50,428 - usage_reporter - INFO - Sending usage report for 60 usage seconds, 1 units 2022-11-04 14:54:51,165 - clearml.Auto-Scaler - WARNING - Can not get console logs from instance 4423912289108270944.Reason: [SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:2635) malloc(): unsorted double linked list corrupted 2022-11-04 15:54:54 Process failed, exit code -6