Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, What Is The Best Way To Get A Local Copy Of Only The Specified Files From The Dataset? Case: I Got A List Of Added Files For N Versions Using Dataset.List_Added_Files() And I Want To Download Them To A Folder

Hi,
What is the best way to get a local copy of only the specified files from the dataset?
Case: I got a list of added files for N versions using Dataset.list_added_files() and i want to download them to a folder

  
  
Posted 11 months ago
Votes Newest

Answers 3


Hi @<1523701790044852224:profile|FreshParrot56> , the dataset will always be fetched locally in order to get your files

  
  
Posted 11 months ago

That's not currently supported, it's something that's possible with the ClearML HyperDatasets, but not with the ClearML Datasets in the open source version

  
  
Posted 11 months ago

But is there a way to download only the files I need, and not the entire dataset? something like my_dataset.get_mutable_local_copy(my_path, files=['1.png', '2.png'])

  
  
Posted 11 months ago
642 Views
3 Answers
11 months ago
11 months ago
Tags