Literally just opened that page as your message came through!
Great to know I'm going in the right direction, I'll give it a go, thanks!
Not sure if ClearML has any built in support, but we used the above for a similar issue but with Prefect2 :)
Cool I'll let you know how it goes 🙂
That's all set up and handy to use locally but I can't see that there's any ClearML support for it. Nor can I think of any way of getting the binary into an instance span up by my auto scaler...
Maybe there's something I can change in the aws autoscaler example
Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.
(the extra_vm_bash_script is what you're after)
Took some time to get extra_vm_bash_script set up properly but that's done the job!
Thank you again for the help!