Ok, I've found the problem:
I would run the experiment in a docker container, the credentials from the machine were mounted correctly to the container at first to /root/clearml.conf, later in the experiment the dockerfile changed such to create a user for experiment to run in (to prevent later root perms problems.) which then probably caused the problem due to the user not getting the creds from /root/clearml.conf