Unanswered
Hi Everyone!
I Try To Run Pytorch Lightning Code On Slurm With Srun Script Like This (
Hi @<1569496075083976704:profile|SweetShells3>
Try to do:
import torch.distributed as dist
if dist.get_rank()==0:
task = Task.init(...)
This will make sure only the "master" process is logged
or
if int(os.environ.get('RANK'))==0:
task = Task.init(...)
144 Views
0
Answers
one year ago
one year ago