Unanswered
Hi Everyone!
I Try To Run Pytorch Lightning Code On Slurm With Srun Script Like This (
@<1523701205467926528:profile|AgitatedDove14> in this case I get AttributeError: 'NoneType' object has no attribute 'report_scalar' on trainer.fit(...) And Logger.current_logger() - I think non-master processes trying to log something, but have no Logger instance because have no Task instance.
What am I suppose to do to log training correctly? Logs in master process include all training history or I need to concatenate logs from different nodes somehow?
325 Views
0
Answers
2 years ago
2 years ago