Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hi, What Is The Best Way To Get A Local Copy Of Only The Specified Files From The Dataset? Case: I Got A List Of Added Files For N Versions Using Dataset.List_Added_Files() And I Want To Download Them To A Folder

What is the best way to get a local copy of only the specified files from the dataset?
Case: I got a list of added files for N versions using Dataset.list_added_files() and i want to download them to a folder

Posted one year ago
Votes Newest

Answers 3

But is there a way to download only the files I need, and not the entire dataset? something like my_dataset.get_mutable_local_copy(my_path, files=['1.png', '2.png'])

Posted one year ago

That's not currently supported, it's something that's possible with the ClearML HyperDatasets, but not with the ClearML Datasets in the open source version

Posted one year ago

Hi @<1523701790044852224:profile|FreshParrot56> , the dataset will always be fetched locally in order to get your files

Posted one year ago
3 Answers
one year ago
one year ago