it is just local copy so you can rerun and reconfigure

I have to commit the YAML with my AWS credentials to git.

CleanPigeon16 please do not 🙂
either put them on the Task itself, or as OS env on the machine/agent running the Task.
Regrading where it is stored (I think the default is DevOps project, need to look at the code)

Ohh ignore the YAML

right, of course 🙂 so just to make sure I'm running it correctly. I ran python aws_autoscaler.py --run on my laptop and I see the Task on ClearML. Then took a completed task, cloned it and enqueued to the queue defined on the autoscaler. That should spin up an instance, right? (it currently doesn't, and I'm not sure where to debug)

I should manually copy it to the remote services agents?

The code itself needs to run somewhere, currently this has to be your machine, either you manually run the AWS autoscaler or an agents runs it for you. Make sense ?

ok cool

It is stored on the Task itself

I looked there, but couldn't find it. I'm currently experimenting with your free hosted server

https://github.com/allegroai/clearml/blob/8658198f8bac976e5c2766190d8c593c2308bfa1/examples/services/aws-autoscaler/aws_autoscaler.py#L82

That should spin up an instance, right? (it currently doesn't, and I'm not sure where to debug)

Do you see the AWS scaler Task running ?
(This is the code/process that actually spins a new EC2 instance)

something needs to run the autoscaler, I thought it would be the machine that runs the services queue, no?

no need for it actually

when I ran the script it autogenerated the YAML, so I should manually copy it to the remote services agents?

Exactly, just pointing to the fact that, that machine is yours ;)