Yes, I have the controller task in hand

Anyway I checked the base task, and this is what it has in installed packages (seems like it doesn't list all the real packages in the environment)

How can I change the version of the Cleanup Service?

Let's take a step back. Let's remove the clearml-services from the docker compose for a second, and run it manually (then you can control everything). Once you have it running manually, let's try to replicate the setup back to the docker compose, make sense ?

I'd prefer not to docker-compose down as researchers are actively working on it, what do you say that I will manually kill the services agent and launch one myself?

AgitatedDove14 sorry for the late reply,

It's right after executing all the steps. So we have the following block which determines whether we run locally or remotely

if not arguments.enqueue: pipe.start_locally(run_pipeline_steps_locally=True) else: pipe.start(queue=arguments.enqueue)
And right after we have a method that calls Task.current_task() which returns None

For example, this is one execution:

Now I remind you that using the same credentials exactly, the auto scaler task could launch instances before

😄