if I want to resume a training on multi gpu, I will need to call this function on each process to send the weights to each gpu
I think it should work fine, please update 🙂
Answered
Hi, In The Context Of Multi-Gpu Training, Is
Hi, in the context of multi-gpu training, is Model.get_local_copy() multi-process safe? or should make sure only the first process calls it first, then others
559 Views
3
Answers
2 years ago
one year ago
Tags