Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Is There A Way To Pull Clearml Datasets To A Mounted Pv Instead Of The Pod'S Local Directory.

Hi, is there a way to pull clearml datasets to a mounted pv instead of the pod's local directory.

  
  
Posted 8 months ago
Votes Newest

Answers 7


@<1523701205467926528:profile|AgitatedDove14> when my codes get the clearml datasets, it stores in the cache e.g. /$HOME/.clearml/cache....

I wanted it to be in a mounted PV instead, so other pods (in same node) who needed same datasets can use without pulling again.

  
  
Posted 8 months ago

When you set the pod make sure you mount the clearml local cache folder to the PV
basically /root/.clearml/cache/

  
  
Posted 8 months ago

I have yet to figure out how to do so, would appreciate if u could give some guidance

  
  
Posted 8 months ago

Hi @<1523701304709353472:profile|OddShrimp85>
Do you mean Dataset.get_local_copy() ?

  
  
Posted 8 months ago

By the way, will downloading still happen if the datasets is available in the cache folder?

If it is cached, then there is no need to re-download 🙂

  
  
Posted 8 months ago

By the way, will downloading still happen if the datasets is available in the cache folder? Any specific settings to add to Dataset.get_local_copy()?

  
  
Posted 8 months ago

OK let me try by adding to vol mount.

  
  
Posted 8 months ago
532 Views
7 Answers
8 months ago
8 months ago
Tags