Reputation
Badges 1
5 × Eureka!I just check that, you're right! The iteration and metrics are definitely the same (same epoch, metric is "debug_samples"
), but the variant was initially different (it was a simple f"{batch}{elem}"
). The bug started showing up when I started using the variant (or series) to show the label as text. As a consequences, I end up with samples from the same batch, with the same label being reported with the same iteration+metric+variant.
I just did that after realising the issue, thank you! 🙂
@<1523701087100473344:profile|SuccessfulKoala55> here a screen capture to show you what I mean
hi @<1523703436166565888:profile|DeterminedCrab71> thank you for looking into this! I'm not sure if this is the problem. What I'm trying to do is simply displaying some of the images produced by my data generator in clearml. I have a callback that at the beginning of each epoch, for each image in the batch, simply calls report_image
on every element of the batch. Because data augmentation is part of the elements I want to investigate, the same images are reported at every epoch. However...