Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Does Anyone Know Why Uploading A Dataset From Your Local Machine Sets A

Does anyone know why uploading a dataset from your local machine sets a localhost reference in the dataset output? This makes it so the remotely running tasks can't download the dataset from k8s pods.

  
  
Posted 3 months ago
Votes Newest

Answers 5


My local clearml config on my laptop is set to this

This is the issue. Your clearml.conf shouldn't be pointing to localhost but to the address of the server

  
  
Posted 3 months ago

Hi @<1840924578885406720:profile|VictoriousFish46> , how are you uploading the dataset? Did you set output_uri? What is set as your files server in the api section of your clearml.conf ?

  
  
Posted 3 months ago

I thought the dataset address was referenced by the dataset name not the clearml.conf? Like the dataset is getting pulled in the code by this command

data_path = Dataset.get(dataset_name="Fashion MNIST", alias="Fashion MNIST").get_local_copy()

So I would assume the code would use the clearml.conf of the running environment?

  
  
Posted 3 months ago

My local clearml config on my laptop is set to this

api {
  web_server: 

  api_server: 

  files_server: 

  credentials {
    "access_key" = "***"
    "secret_key" = "***"
  }
}
  
  
Posted 3 months ago

The data is in my laptop in a folder called fashion_mnist .
The contents of my clearml.conf are produced from the values passed to the helm chart as such

agentk8sglue:
  apiServerUrlReference:  "
"
  fileServerUrlReference: "
"
  webServerUrlReference:  "
"
  extraEnvs:
    - name: CLEARML_AGENT_UPDATE_VERSION
      value: "==1.9.2"
    - name: CLEARML_API_HOST
      value: "
"
    - name: CLEARML_FILES_HOST
      value: "
"
    - name: CLEARML_WEB_HOST
      value: "
"

The dataset was created like this

clearml-data create --project "Full Overview" --name "Fashion MNIST"
clearml-data add --files fashion_mnist
clearml-data close

I didn't set the output uri, I think that was created by the cli or something else.

  
  
Posted 3 months ago
248 Views
5 Answers
3 months ago
3 months ago
Tags