I have to commit the YAML with my AWS credentials to git.

CleanPigeon16 please do not 🙂
either put them on the Task itself, or as OS env on the machine/agent running the Task.
Regrading where it is stored (I think the default is DevOps project, need to look at the code)

https://github.com/allegroai/clearml/blob/8658198f8bac976e5c2766190d8c593c2308bfa1/examples/services/aws-autoscaler/aws_autoscaler.py#L82

I looked there, but couldn't find it. I'm currently experimenting with your free hosted server

when I ran the script it autogenerated the YAML, so I should manually copy it to the remote services agents?

Ohh ignore the YAML

it is just local copy so you can rerun and reconfigure

no need for it actually

It is stored on the Task itself

ok cool

I should manually copy it to the remote services agents?

The code itself needs to run somewhere, currently this has to be your machine, either you manually run the AWS autoscaler or an agents runs it for you. Make sense ?

something needs to run the autoscaler, I thought it would be the machine that runs the services queue, no?

Exactly, just pointing to the fact that, that machine is yours ;)

right, of course 🙂 so just to make sure I'm running it correctly. I ran python aws_autoscaler.py --run on my laptop and I see the Task on ClearML. Then took a completed task, cloned it and enqueued to the queue defined on the autoscaler. That should spin up an instance, right? (it currently doesn't, and I'm not sure where to debug)

That should spin up an instance, right? (it currently doesn't, and I'm not sure where to debug)

Do you see the AWS scaler Task running ?
(This is the code/process that actually spins a new EC2 instance)