Not sure if ClearML has any built in support, but we used the above for a similar issue but with Prefect2 :)
That's all set up and handy to use locally but I can't see that there's any ClearML support for it. Nor can I think of any way of getting the binary into an instance span up by my auto scaler...
Maybe there's something I can change in the aws autoscaler example
(the extra_vm_bash_script is what you're after)
Cool I'll let you know how it goes 🙂
Took some time to get extra_vm_bash_script set up properly but that's done the job!
Thank you again for the help!
Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.
Literally just opened that page as your message came through!
Great to know I'm going in the right direction, I'll give it a go, thanks!