CostlyOstrich36 thanks.
Maybe I should pass something in extra_docker_arguments in the config file?
I just added -p port_num:port_num to extra_docker_arguments
But now I have diffrent problem, in the dataset.get_mutable_local_copy
I get:
File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 1276, in _download_part
raise ValueError("Could not download dataset id={} entry={}".format(self._id, data_artifact_name))
ValueError: Could not download dataset
Are you running it inside a docker yourself or is it run via the agent?
Maybe I should pass something in extra_docker_arguments?
CostlyOstrich36
I found the problem I think, thanks!
You ran the same exact command for agent one with --docker
and one without --docker
and the one without managed to reach the files?
When the docker runs, does it print out the aws user key correctly?
Cool, let me take a look and see what can be done 🙂
Can you try running it via agent without the docker?
And again only in docker mode CostlyOstrich36
The sdk.aws.s3.credentials.0.host and sdk.aws.s3.credentials.0.key, yes
Are you running both locally? Is the agent's clearml.conf
configured with the credentials as well?