and for the record - to override hydra params the syntax is :parameter_override={'Hydra/x.y':1234}where x.y=1234 is how you would override the param via the cli
I think it works.
small correction - use slash and not dot in configuration/OmegaConf:parameter_override={'configuration/OmegaConf': dict...')})
Okay this is a bit tricky (and come to think about it, we should allow a more direct interface):pipe.add_step(name='train', parents=['data_pipeline', ], base_task_project='xxx', base_task_name='yyy', task_overrides={'configuration.OmegaConf': dict(value=yaml.dump(MY_NEW_CONFIG), name='OmegaConf', type='OmegaConf YAML')} )Notice that if you had any other configuration on the base task, you should add them as well (basically it overwrites the configuration section)
Do you think this will work?
the above only passes the overrides if I am not mistaken
I want to pass the entire hydra omegaconf as a (nested) dictionary
RoughTiger69 the easiest thing would be to use the override option of Hydra:parameter_override={'Args/overrides': '[the_hydra_key={}]'.format(a_new_value)})wdyt?
CostlyOstrich36pipe.add_step(name='train', parents=['data_pipeline', ], base_task_project='xxx', base_task_name='yyy', parameter_override={'OmegaConf': cfg.trainer})
RoughTiger69 , Hi!
Can you please add a snippet of how you're trying to add it?
