Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, It Seems Like When I Upload The Dataset To Clearml With The Methods From The Dataset Class. It Packed The Whole Dataset Into Several .Zip Files In /Tmp Folder Before Uploading. I'D Like To Know Whether I Can Point The .Zip Files To Be Saved Somewhere

Hi, It seems like when I upload the dataset to ClearML with the methods from the Dataset class. It packed the whole dataset into several .zip files in /tmp folder before uploading. I'd like to know whether I can point the .zip files to be saved somewhere else rather than /tmp folder cuz, for the large dataset, i cannot store these .zip files in the local machine. So, i want to point them out to be saved in some mounted directory instead.

  
  
Posted one year ago
Votes Newest

Answers 3


Hi DeterminedOwl36 , what about simply adding files that are already sitting on some storage?
https://clear.ml/docs/latest/docs/references/sdk/dataset#add_external_files

  
  
Posted one year ago

If you set the TMP env variable you can control the tmp folder. Would that work?

  
  
Posted one year ago

Thanks AgitatedDove14 , I tried setting TEMP environment variable to another directory and it worked! Not sure whether TMP could work too.

  
  
Posted one year ago
670 Views
3 Answers
one year ago
one year ago
Tags