Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Quick Question. If I Use Clearml-Data To Upload A Dataset To A Remote Folder Which Is Mounted At, Say, /Mnt/Something/Data, When I Use Dataset.Get_Local_Copy(), It Looks Like It Is Unzipping That Data Also In The Remote Folder And Thus Returning The A

Hi quick question. If i use clearml-data to upload a dataset to a remote folder which is mounted at, say, /mnt/something/data, when i use Dataset.get_local_copy(), it looks like it is unzipping that data also in the remote folder and thus returning the a remote folder as the "local" copy. Is there some way to force it to download the dataset to a specified location that is actually on my local machine?

  
  
Posted 3 years ago
Votes Newest

Answers 7


Hi StormyOx60
Yes, by default it assumes any "file://" or local files, are accessible (which makes sense because if they are not, it will not able to download them).

there some way to force it to download the dataset to a specified location that is actually on my local machine?

You can specify a specific folder is not "local" and what it will do it will copy the zip locally and unzip it.
Is this what you are after ?

  
  
Posted 3 years ago

yes, thank you

  
  
Posted 3 years ago

do I need to create a brand new dataset with a new name that inherits from the original?

Yes, you just create a new version, specify the parent one, add changes and close it.
If you later need you can squash a version (same ides as git squash). Make sense ?

  
  
Posted 3 years ago

although ideally i'd like to tell it exactly where to unzip it.

Ohh you can use .get_local_mutable_copy()
It will unzip it to specific folder

  
  
Posted 3 years ago

although ideally i'd like to tell it exactly where to unzip it. my project assumes a specific directory structure

  
  
Posted 3 years ago

yes i think so

  
  
Posted 3 years ago

got it, thanks 🙂 another thing, i can't find a clear explanation of if/how datasets can be updated. Lets say I have some dataset already created and uploaded, but then i want to add/delete/modify some files to create "version 2" of the dataset, do I need to create a brand new dataset with a new name that inherits from the original?

  
  
Posted 3 years ago
980 Views
7 Answers
3 years ago
one year ago
Tags