clearml 1.6.2 clearml-agent 1.3.0 hydra-core 1.1.2
Just making sure we cover all bases - you changed updated the optimized to use a base task with _allow_omegaconf_edit_ : True
Hi FranticLobster32 , what version of ClearML, of Agent & Hydra are you using?
but sadly when you compare different experiments with different parameters, all the scalar graphs are identical which shouldn’t be the case
In the task hyper parameters section you have a section called Hydra. In that section there should be a configuration called _allow_omegaconf_edit_
, what is it set to?
Cool, let me know if I can help in anyway. I can also try mocking up a small example on my side
Aight. Thanks for the information. I'll take a look and see if it reproduces for me as well 🙂
Yes, the base task is the same, minus the parameters I’m trying to overwrite with the HPO. Here’s the screenshot from the base task
WebApp: 1.6.0-213 • Server: 1.6.0-213 • API: 2.20
hydra-core 1.1.2
Please try setting it to True, that should fix it
CostlyOstrich36
I’m fully confident at this point that changing parameters on Hydra experiments doesn’t work with clearML. Thus I have reverted to converting Hydra hparams to normal hparams
` @hydra.main(config_path="conf", config_name="config")
def main(config: DictConfig):
task = Task.init(
config.logging.trackerParams.project,
config.logging.trackerParams.experimentName,
)
config = task.connect(OmegaConf.to_container(config)) `which seems to work.
All of this being said, I’d very much like Hydra + HPO to work as intended. So I am thinking should I escalate this to an issue on Github and provide a minimal example?
Tried it with both parameter naming schemes ( "Hydra/*"
and "General/*"
) but it didn’t work 😕
Yes, the screenshot is from one of the HPO child tasks