Reputation
Badges 1
979 × Eureka!Hey SuccessfulKoala55 , unfortunately this doesnโt work, because the dict contains others dicts, and only the first level dict becomes a dict, the inner dicts still are ProxyDictPostWrite
and will make OmegaConf.create fail
Otherwise I can try loading the file with custom loader, save as temp file, pass the temp file to connect_configuration, it will return me another temp file with overwritten config, and then pass this new file to OmegaConf
Ok, so what worked for me in the end was:config = task.connect_configuration(read_yaml(conf_path)) cfg = OmegaConf.create(config._to_dict())
ProxyDictPostWrite._to_dict()
will recursively convert to dict and OmegaConf will not complain then
it would be nice if Task.connect_configuration could support custom yaml file readers for me
but then why do I have to do task.connect_configuration(read_yaml(conf_path))._to_dict()
?
Why not task.connect_configuration(read_yaml(conf_path))
simply?
I mean what is the benefit of returning ProxyDictPostWrite
instead of a dict?
erf, I have the same problem with ProxyDictPreWrite ๐ What is the use case of this one ?
I ended up dropping omegaconf altogether
Yes thatโs what I did initially, but eventually I decided that itโs too much complexity added for nothing really, Iโd rather drop omegaconf and if one day clearml supports it out of the box take advantage of it
AgitatedDove14 Same problem with clearml==1.1.5rc2
๐ , I also tried with backend==gloo
, still same problem
I am not using hydra, I am reading the conf with:config_dict = read_yaml(conf_yaml_path) config = OmegaConf.create(task.connect_configuration(config_dict))
Yea, the config is not appearing in the webUI anymore with this method ๐
Can I simply set agent.python_binary = path/to/conda/python3.6
?
even if I move the Github workers internally where they could have access to the prod server, I am not sure I would like that, because it would pile up test data in the prod server that is not necessary
continue_last_task
is almost what I want, the only problem with it is that it will start the task even if the task is completed
For new projects it works ๐
UnevenDolphin73 , task = clearml.Task.get_task(clearml.config.get_remote_task_id())
worked, thanks
Answering myself: Yes, Task.set_base_docker
RTFM!!!
If the reporting is done on a subprocess, I can imagine that the task.set_initial_iteration(0)
call is only effective in the main process, not in the subprocess used for reporting. Could it be the case?
But I see in the agent logs:Executing: ['docker', 'run', '-t', '--gpus', '"device=0"', ...
Ok, I could reproduce with Firefox and Chromium. Steps:
Add creds (either via the popup or in the settings) Go the /settings/webapp-configuration -> Creds should be there Hit F5 Creds are gone
AgitatedDove14 It was only on comparison as far as I remember
I am not sure what you mean by unless the domain is different
? Personal Access Token are designed such that to allow cloning a private repo, the user has to give the PAT full access to repos, including public repos. So it should also work with all other git repos
Sure, I opened an issue https://github.com/allegroai/clearml/issues/288 unfortunately I don't have time to open a PR ๐
AgitatedDove14 Yes exactly, I tried the fix suggested in the github issue urllib3>=1.25.4
and the ImportError disappeared ๐
So I guess the problem is that the following snippet:from clearml import Task Task.init()
Should be added before the if __name__ == "__main__":
?
Hi, /opt/clearml is ~40Mb, /opt/clearml/data is about ~50gb