Unanswered
Hi Everyone!
I Try To Run Pytorch Lightning Code On Slurm With Srun Script Like This (
@<1523701205467926528:profile|AgitatedDove14> in this case I get AttributeError: 'NoneType' object has no attribute 'report_scalar'
on trainer.fit(...)
And Logger.current_logger()
- I think non-master processes trying to log something, but have no Logger instance because have no Task instance.
What am I suppose to do to log training correctly? Logs in master process include all training history or I need to concatenate logs from different nodes somehow?
150 Views
0
Answers
one year ago
one year ago