Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hi, What Is The Best Way To Get A Local Copy Of Only The Specified Files From The Dataset? Case: I Got A List Of Added Files For N Versions Using Dataset.List_Added_Files() And I Want To Download Them To A Folder

What is the best way to get a local copy of only the specified files from the dataset?
Case: I got a list of added files for N versions using Dataset.list_added_files() and i want to download them to a folder

Posted 7 months ago
Votes Newest

Answers 3

But is there a way to download only the files I need, and not the entire dataset? something like my_dataset.get_mutable_local_copy(my_path, files=['1.png', '2.png'])

Posted 7 months ago

That's not currently supported, it's something that's possible with the ClearML HyperDatasets, but not with the ClearML Datasets in the open source version

Posted 7 months ago

Hi @<1523701790044852224:profile|FreshParrot56> , the dataset will always be fetched locally in order to get your files

Posted 7 months ago
3 Answers
7 months ago
7 months ago