agent, in docker mode

But now I have diffrent problem, in the dataset.get_mutable_local_copy
I get:

File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 1276, in _download_part
raise ValueError("Could not download dataset id={} entry={}".format(self._id, data_artifact_name))
ValueError: Could not download dataset

What was the problem?

I just added -p port_num:port_num to extra_docker_arguments

Are you running it inside a docker yourself or is it run via the agent?

Yes, I will try

CostlyOstrich36 thanks.
Maybe I should pass something in extra_docker_arguments in the config file?

Can you try running it via agent without the docker?

Cool, let me take a look and see what can be done 🙂

You ran the same exact command for agent one with --docker and one without --docker and the one without managed to reach the files?

CostlyOstrich36 Yes Its work

CostlyOstrich36

Are you running both locally? Is the agent's clearml.conf configured with the credentials as well?

And again only in docker mode CostlyOstrich36

Maybe I should pass something in extra_docker_arguments?
CostlyOstrich36

The sdk.aws.s3.credentials.0.host and sdk.aws.s3.credentials.0.key, yes

CostlyOstrich36 Yes

I found the problem I think, thanks!

When the docker runs, does it print out the aws user key correctly?

Yes
CostlyOstrich36