Unanswered
Problem: Excessive Scalar Storage From Tensorboard Integration Causing Out-Of-Memory On Clearml Server
Hi Team,
We’Ve Run Into A Problem With Clearml Ingesting Extremely Large Numbers Of Scalars From Tensorboard (Auto_Connect_Frameworks) (~800K Samples P
Hi @<1853245764742942720:profile|DepravedKoala88> , I don't think there is any downsampling when ingesting from Tensorboard. You can always turn off the autologging and only log what you want and downsample accordingly. Keep in mind that on one hand you should avoid bloat on the server and on the other have high enough granularity in your scalars.
What do you think?
45 Views
0
Answers
2 months ago
2 months ago