Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, It Seems Like When I Upload The Dataset To Clearml With The Methods From The Dataset Class. It Packed The Whole Dataset Into Several .Zip Files In /Tmp Folder Before Uploading. I'D Like To Know Whether I Can Point The .Zip Files To Be Saved Somewhere

Hi, It seems like when I upload the dataset to ClearML with the methods from the Dataset class. It packed the whole dataset into several .zip files in /tmp folder before uploading. I'd like to know whether I can point the .zip files to be saved somewhere else rather than /tmp folder cuz, for the large dataset, i cannot store these .zip files in the local machine. So, i want to point them out to be saved in some mounted directory instead.

  
  
Posted one year ago
Votes Newest

Answers 3


Thanks AgitatedDove14 , I tried setting TEMP environment variable to another directory and it worked! Not sure whether TMP could work too.

  
  
Posted one year ago

If you set the TMP env variable you can control the tmp folder. Would that work?

  
  
Posted one year ago

Hi DeterminedOwl36 , what about simply adding files that are already sitting on some storage?
https://clear.ml/docs/latest/docs/references/sdk/dataset#add_external_files

  
  
Posted one year ago
707 Views
3 Answers
one year ago
one year ago
Tags