Unanswered
Hi I Was Running An Hyperparameter Optimization Task Using The Optuna Optimizer And Even Though The Hyperparameteroptimizer’S Argument Is Set To
Hi UpsetBlackbird87
This is an Optuna decision on how many concurrent tests to run simultaneously.
You limited it to 100, but remember Optuna does a Bayesian optimization process, where it decides on the best set of arguments based on the performance of the previous set, this means it will first try X trials, then decide on the next batch.
That said you can a pruner to Optuna specifying how it should start
https://optuna.readthedocs.io/en/v1.4.0/reference/pruners.html#optuna.pruners.MedianPrunerHyperParameterOptimizer(..., optimizer_kwargs=dict( optuna_pruner=optuna.pruners.MedianPruner(n_startup_trials=50, n_warmup_steps=30, interval_steps=10)))
Make sense ?
159 Views
0
Answers
2 years ago
one year ago