Unanswered
Hey Everyone, I'M Using Clearml Pipeline, I Have A Pre-Processing Step Which I Would Like To Use There Small Instance, And Processing Step Which Executed On A Gpu Queue.
The Initialisation Time Of The Gpu Instance Is Very Long. Is There A Way To Configure
You can set a dummy step which is executed in parallel of your pre-processing step and which is set to be executed in your GPU queue, provided that your autoscaler doesn't scale back your compute before your pre-processing is complete that should do the trick
124 Views
0
Answers
11 months ago
11 months ago