Hi @<1523701122311655424:profile|VexedElephant56> , I think is achievable with Slurm + ClearML, however I don't think something like this out of the box exists
Answered
Hello, Does Anybody Here Work With Clearml On Preemptible Instances? I'D Like To Achieve The Following:
Hello, does anybody here work with ClearML on preemptible instances? I'd like to achieve the following:
- I enqueue a preemptible task A
- Task A gets fetched by a worker
- Task A is signaled to be preempted by more important task B
- Task A dumps its state somewhere and ends to be requeued
- Task B gets executed and gets finished
- Task A is fetched by a worker again
Can Slurm + ClearML achieve that? I currently work with ClearML with Docker-based agents.
1K Views
1
Answer
one year ago
one year ago
Tags