after playing with it a bit more, i figured out that you need to set _ allow omegaconf_edit_ to False and the parameters naming should be done with dot notation. for example Hydra/some_key. other_key.my _key . there is no documentation regarding hydra with hyperparameters tuning, it is best to add a section regarding it in the link you attached.