Unanswered
Hello!
How Can I Save And Resume Studies With Optune?
If Best Quality Have Not Reached Or Another Reasons.
Optune Have Capabilities For Resuming Studies.
Hi!
I believe you can stop and resume studies by adding these actions to your script:
Add save points via joblib.dump()
and connect them to clearml via clearml.model.OutputModel.connect()
Then, when you want to start or resume a study, load latest study file via joblib.load() and connect to clearml with http://clearml.model.InputModel.co nnect()
This way you can stop your training sessions with the agent and resume them from nearly the same point
I think all the required references are here: https://clear.ml/docs/latest/docs/references/sdk/model_model
142 Views
0
Answers
3 years ago
one year ago
Tags