When I launch multiple experiments across a parameter grid using hydra multirun, the scalars that were auto connected from tensorflowx act as if they were continuing from the same experiment in serial rather than different experiments. This makes it difficult to compare scalars across different experiments.
HighOtter69
By default if you are continuing an experiment it will start from the last iteration of the previous run. you can reset it with:task.set_initial_iteration(0)
I've tried explicitly resetting the iteration account back to 0 across runs using set_initial_iteration with no luck
The newest rc does indeed fix the issue, thank you!
So what's weird is that I'm explicitly closing the task but the separate experiments are not starting back at iteration 0
HighOtter69
Could you test with the latest RC? I think this fixed it:
https://github.com/allegroai/clearml/issues/306
the separate experiments are not starting back at iteration 0
What do you mean by that?
Hi HighOtter69 ,
Can you share the ClearML version you use?
