When I launch multiple experiments across a parameter grid using hydra multirun, the scalars that were auto connected from tensorflowx act as if they were continuing from the same experiment in serial rather than different experiments. This makes it difficult to compare scalars across different experiments.
Hi HighOtter69 ,
Can you share the ClearML version you use?
the separate experiments are not starting back at iteration 0
What do you mean by that?
HighOtter69
Could you test with the latest RC? I think this fixed it:
https://github.com/allegroai/clearml/issues/306
HighOtter69
By default if you are continuing an experiment it will start from the last iteration of the previous run. you can reset it with:task.set_initial_iteration(0)
I've tried explicitly resetting the iteration account back to 0 across runs using set_initial_iteration with no luck
So what's weird is that I'm explicitly closing the task but the separate experiments are not starting back at iteration 0
The newest rc does indeed fix the issue, thank you!