Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
[Datasets] Is It Possible To Get An Individual File From A Dataset? Example Would Be Accessing Only A Single Feature From A Feature Store Dataset When It Could Be Costly To Download The Entire Dataset

[Datasets] is it possible to get an individual file from a dataset?
Example would be accessing only a single feature from a feature store Dataset when it could be costly to download the entire dataset

Posted 10 months ago
Votes Newest

Answers 4

I suppose your worker is not persistent, so I might suggest having a very cheap instance as a persistent worker where you have your dataset persistently synced using . https://clear.ml/docs/latest/docs/references/sdk/dataset/#sync_folder and then taking the subset of files that interests you and pushing it as a different dataset, marking it as a subset of your main dataset id using a tag

Posted 10 months ago

And after your modifications are made you can use . https://clear.ml/docs/latest/docs/references/sdk/dataset/#datasetsquash to squash your modified subset with the main dataset if you want to re-integrate it in your flow. But I don't remember if squash requires the both datasets to be present locally or not...

Posted 10 months ago

Ahh. This is a shame. I really want to use ClearML to efficiently compute features but itโ€™s proving a challenge!

Posted 10 months ago

I doubt there is a direct way to do it since they are stored as archive chunks ๐Ÿ˜•

Posted 10 months ago
4 Answers
10 months ago
10 months ago