If you could provide the specific task ID then it could fetch the training data and study from the previous task and continue with the specified number of trainings.

Yes exactly, and also all the definitions for the HPO process (variables space, study etc.)

The reason that being able to continue from a past study would be useful is that the study provides a base for pruning and optimization of the task. The task would be stopped by aborting when the gpu-rig that it is using is needed or the study crashes.

that makes sense

My current use case is just research for training pytorch models.

👍

UnevenBee3 just to make sure we do not forget to add it, maybe you could open a GitHub issue with the feature request?