Sure, I can polish my code of corse, but wanted to first check if there is to be any useful.
Thanks @<1523703472304689152:profile|UpsetTurkey67>
I'm pretty sure it has!
Let me check how we can merge it into the cleamrl-agent, sounds good?
@<1523701205467926528:profile|AgitatedDove14> some time ago I wrote a simple glue code to spin slurm workers (clearml agents) when there are tasks enqueued. The workers are killed when idle for a specific amount of time in order not to block the GPUs (slurm resources), this code is not polished, but wanted to ask you whether you think it has value for other community members? None
Sure, I can polish my code of corse, but wanted to first check if there is to be any useful.
Thanks @<1523703472304689152:profile|UpsetTurkey67>
I'm pretty sure it has!
Let me check how we can merge it into the cleamrl-agent, sounds good?