That should spin up an instance, right? (it currently doesn't, and I'm not sure where to debug)

Do you see the AWS scaler Task running ?
(This is the code/process that actually spins a new EC2 instance)

Exactly, just pointing to the fact that, that machine is yours ;)

I should manually copy it to the remote services agents?

The code itself needs to run somewhere, currently this has to be your machine, either you manually run the AWS autoscaler or an agents runs it for you. Make sense ?

ok cool

something needs to run the autoscaler, I thought it would be the machine that runs the services queue, no?

I have to commit the YAML with my AWS credentials to git.

CleanPigeon16 please do not 🙂
either put them on the Task itself, or as OS env on the machine/agent running the Task.
Regrading where it is stored (I think the default is DevOps project, need to look at the code)

https://github.com/allegroai/clearml/blob/8658198f8bac976e5c2766190d8c593c2308bfa1/examples/services/aws-autoscaler/aws_autoscaler.py#L82

I looked there, but couldn't find it. I'm currently experimenting with your free hosted server

when I ran the script it autogenerated the YAML, so I should manually copy it to the remote services agents?

it is just local copy so you can rerun and reconfigure

It is stored on the Task itself

no need for it actually

Ohh ignore the YAML

right, of course 🙂 so just to make sure I'm running it correctly. I ran python aws_autoscaler.py --run on my laptop and I see the Task on ClearML. Then took a completed task, cloned it and enqueued to the queue defined on the autoscaler. That should spin up an instance, right? (it currently doesn't, and I'm not sure where to debug)