Hi UnevenBee3 , the OptimizerOptuna class should already be able to prune any bad tasks, provided the model itself is iteration-based (so no SVM etc. need iterations for early stopping). You can read our blogpost here: https://clear.ml/blog/how-to-do-hyperparameter-optimization-better/

Also, I was wondering if there was a way to sort out folders and create a sub folder with the tasks with adjusted hyperparameters so that we can access them but they don't take up quite so much space.

Yeah, I do the same thing all the time. You can limit the amount of tasks that are kept in HPO with the save_top_k_tasks_only parameter and you can create subprojects by simply using a slash in the name 🙂 https://clear.ml/docs/latest/docs/fundamentals/projects#creating-subprojects

Thanks, this was really helpful. Would be a good thing to have on the hyperparameter tuning page in the docs if you can add it.