Can I launch training with HugginFaces accelerate package using multi-gpu option and Task.execute_remotely() ? Currently it fails:
clearml.backend_interface.session.SendError: Action failed <400/110: tasks.enqueue/v1.0 (Invalid task status (Task already in requested status): current_status=queued, new_status=queued)> (queue=291e0d3ecd6b4cd889f78e957a7a6037, task=d31d7e5a56ce41edbbd947bc35ff0621, verify_watched_queue=False)
It detects torch distributed but I guess I need to setup main task?
Hi @<1657918724084076544:profile|EnergeticCow77>
Can I launch training with HugginFaces accelerate package using multi-gpu
Yes,
It detects torch distributed but I guess I need to setup main task?
It should 🤞
Under the execution Tab script path, you should see something like -m torch.distributed.launch ...
