Are you running it inside a docker yourself or is it run via the agent?

agent, in docker mode

Maybe I should pass something in extra_docker_arguments?
CostlyOstrich36

Are you running both locally? Is the agent's clearml.conf configured with the credentials as well?

Yes
CostlyOstrich36

Can you try running it via agent without the docker?

Yes, I will try

CostlyOstrich36 Yes Its work

You ran the same exact command for agent one with --docker and one without --docker and the one without managed to reach the files?

CostlyOstrich36 Yes

Cool, let me take a look and see what can be done 🙂

CostlyOstrich36 thanks.
Maybe I should pass something in extra_docker_arguments in the config file?

When the docker runs, does it print out the aws user key correctly?

The sdk.aws.s3.credentials.0.host and sdk.aws.s3.credentials.0.key, yes

CostlyOstrich36

I found the problem I think, thanks!

But now I have diffrent problem, in the dataset.get_mutable_local_copy
I get:

File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 1276, in _download_part
raise ValueError("Could not download dataset id={} entry={}".format(self._id, data_artifact_name))
ValueError: Could not download dataset

And again only in docker mode CostlyOstrich36

What was the problem?

I just added -p port_num:port_num to extra_docker_arguments