Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey All, Im Using S3 As Files_Server. When I Run A Task Not In A Docker Everything Works, That I Run The Same Task In A Docker I Get: Raise Valueerror("Could Not Download Dataset Id={} Entry={}".Format(Self._Id, Data_Artifact_Name)) Valueerror: Could Not

Hey all,
Im using s3 as files_server.
When I run a task not in a docker everything works, that I run the same task in a docker I get:

raise ValueError("Could not download dataset id={} entry={}".format(self._id, data_artifact_name))
ValueError: Could not download dataset

Who knows what the problem might be?
Thanks

  
  
Posted 2 years ago
Votes Newest

Answers 20


You ran the same exact command for agent one with --docker and one without --docker and the one without managed to reach the files?

  
  
Posted 2 years ago

CostlyOstrich36 Yes Its work

  
  
Posted 2 years ago

CostlyOstrich36 thanks.
Maybe I should pass something in extra_docker_arguments in the config file?

  
  
Posted 2 years ago

The sdk.aws.s3.credentials.0.host and sdk.aws.s3.credentials.0.key, yes

  
  
Posted 2 years ago

I just added -p port_num:port_num to extra_docker_arguments

  
  
Posted 2 years ago

Are you running it inside a docker yourself or is it run via the agent?

  
  
Posted 2 years ago

Yes, I will try

  
  
Posted 2 years ago

Cool, let me take a look and see what can be done 🙂

  
  
Posted 2 years ago

What was the problem?

  
  
Posted 2 years ago

agent, in docker mode

  
  
Posted 2 years ago

Can you try running it via agent without the docker?

  
  
Posted 2 years ago

Are you running both locally? Is the agent's clearml.conf configured with the credentials as well?

  
  
Posted 2 years ago

I found the problem I think, thanks!

  
  
Posted 2 years ago

CostlyOstrich36

  
  
Posted 2 years ago

But now I have diffrent problem, in the dataset.get_mutable_local_copy
I get:

File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 1276, in _download_part
raise ValueError("Could not download dataset id={} entry={}".format(self._id, data_artifact_name))
ValueError: Could not download dataset

  
  
Posted 2 years ago

When the docker runs, does it print out the aws user key correctly?

  
  
Posted 2 years ago

Maybe I should pass something in extra_docker_arguments?
CostlyOstrich36

  
  
Posted 2 years ago

Yes
CostlyOstrich36

  
  
Posted 2 years ago

CostlyOstrich36 Yes

  
  
Posted 2 years ago

And again only in docker mode CostlyOstrich36

  
  
Posted 2 years ago
597 Views
20 Answers
2 years ago
one year ago
Tags
Similar posts