Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Am Having Trouble Understanding How Dataset Caching Works With

I am having trouble understanding how dataset caching works with clearml-data . I am using a clearml-task that runs python code to get a dataset from clearml-data . The worker is a Azure VM. I often run into issue where a dataset was downloaded on the machine, training ran for a few hours, but then dataset is no longer on the machine for validation (and the script crash and model artifact is never uploaded). How / when is dataset cache cleared ?

  
  
Posted 5 months ago
Votes Newest

Answers


Hi @<1644147961996775424:profile|HurtStarfish47> , in the ClearML SDK, all downloaded files are cached in the cache folder, the same goes for downloaded dataset files. By default, this cache is mapped to ~/.clearml/cache and contains the last 100 files downloaded.

  
  
Posted 5 months ago
341 Views
1 Answer
5 months ago
5 months ago
Tags