Any idea what could be going on here?
[2023-01-09 16:18:15,727][root][INFO][utils_atom_fn.py:85] - Running fn: fn_get_heat_map_nan [2023-01-09 16:18:15,782][root][INFO][utils_data_quality.py:177] - Saving locally /root/.clearml/venvs-builds/3.8/task_repository/Prediction_Service_Core.git/html_df_nan.html [2023-01-09 16:18:15,782][root][INFO][utils_data_quality.py:194] - Saving plot in clearml! 2023-01-09 11:20:46 ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start 2023-01-09 11:21:27 2023-01-09 16:21:23,168 WARNING Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312d30f70>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2023-01-09 16:21:23,168 WARNING Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312d30f70>: Failed to establish a new connection: [Errno 111] Connection refused')': / [2023-01-09 16:21:23,168][urllib3.connectionpool][WARNING][connectionpool.py:812] - Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312d30f70>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2023-01-09 11:22:32 2023-01-09 16:22:28,812 WARNING Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312cff1f0>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2023-01-09 16:22:28,812 WARNING Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312cff1f0>: Failed to establish a new connection: [Errno 111] Connection refused')': / [2023-01-09 16:22:28,812][urllib3.connectionpool][WARNING][connectionpool.py:812] - Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312cff1f0>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2023-01-09 11:23:43 2023-01-09 16:23:38,415 WARNING Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312cff430>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2023-01-09 16:23:38,415 WARNING Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312cff430>: Failed to establish a new connection: [Errno 111] Connection refused')': / [2023-01-09 16:23:38,415][urllib3.connectionpool][WARNING][connectionpool.py:812] - Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2312cff430>: Failed to establish a new connection: [Errno 111] Connection refused')': / 2023-01-09 11:24:43 2023-01-09 16:24:40,256 - clearml.storage - ERROR - Exception encountered while uploading [Errno 2] No such file or directory: '/root/.clearml/venvs-builds/3.8/task_repository/Prediction_Service_Core.git/html_df_nan.html'
