I'm running locally, yes. I have 8 GPUs Here's a MWE of the https://raw.githubusercontent.com/allegroai/clearml/master/examples/frameworks/pytorch/pytorch_distributed_example.py combined with https://pytorch.org/tutorials/intermediate/ddp_tutorial.html :https://gist.github.com/pazbunis/97a65adbab073dcdcb90954e4e346892

Much appreciated!