Hi @<1691620877822595072:profile|FlutteringMouse14>
Do I have to use Hydra
You can, and then the entire configuration is fully captured by ClearML (automatically) while you can still override values with the manual "key.sub=value" both in the UI and in the CLI
Otherwise you can connect nested dict with task.connect (these will be flattened with / for sub keys).
Or you can connect configuration files ( task.connect_configuration ) and edit them as is in the UI (with override of course)
wdyt?
That's exactly what I was looking for! Thanks a lot.
Just two followup questions
- if I connect a dict with task.connect and I edit it in the UI, will the new values be passed to the next run?
2)with connect_configuration, can I pass a python file containing the configuration (like, a configuration-as-code file, instead of a yml or a json)? Could I modify it from UI?
- yes they will! This is exactly the idea :)
- yes it will store it as text file (as is raw text) notice the return value is the file you should open. This is because when running via agent the return file will contain the conf file from the UI. Make sense?
I had no idea you could do this, that's amazing thanks a lot!
Although after reviewing the options, probably managing everything with Hydra is the better way :D
Lol yeah Hydra is great. Notice you still have the ability to override Hydra from the UI so you really have the best of the two worlds
Yeah that sounds great, look forward to try it! Thanks a lot :)