Hi @<1655744373268156416:profile|StickyShrimp60>
My hydra OmegaConf configuration object is not always being picked up, and I am unable to consistently reproduce it.
... I am using clearml v1.14.4,
Hmm how can we reproduce it? what are you seeing what it does "miss" the hydra, i.e. are you seeing any Hydra section? how are you running the code (manually , agent ?)
@<1523701205467926528:profile|AgitatedDove14> I run the experiments manually for now. It does seem I found the cause of the behaviour, though: I am instantiating an object from my own "tracker" class in my main method that holds from the clearml Task object that actually does the logging. I am doing the instantiation from my configuration via hydra.utils.instantiate
method. So that means import clearml
was not executed before already in my main method annotated with hydra.main
:
@hydra.main(version_base=None, config_path="conf", config_name="config")
def main(cfg: DictConfig):
I now make sure the clearml package is imported before I call my main method and that seems to fix it. What confused me was that instantiating explicitly my tracker object worked, now I think that was because in doing this I would let my IDE add the import tracker statement to the top of the file and clearml would therefore be imported before reaching main method :)