Hey how can I trigger multiple "Hyperparameter Optimization" in a for loop to run on a service? I have around 30 models I'd like to run a BO on in a service queue. If I use the code in this example https://github.com/allegroai/clearml/blob/master/examples/optimization/hyper-parameter-optimization/hyper_parameter_optimizer.py but in a for loop for given task name and base task id. However, the loop exits after the first iteration even if I remove "exit_process=False". Any tips would be appreciated 🙏
Hi RobustRat47 , what if you run them as sub-processes?
For referenceimport subprocess for i in ['1', '2']: command = ['python', 'hyp_op.py', '--testnum', f'{i}'] process = subprocess.Popen(command, shell=True, stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
Yep just about to do that. Just annoying to add arg parser etc
