Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey, When We Change In Our Clearml Conf Local Cache To Our Mounted Nas Drive (Default_Base_Dir: "/Nfs_Client/.Clearml/Cache") Download Speed Is ~50 Times Slower. Did Anybody Encountered This Issue And Or Know How To Fix It ?

Hey, when we change in our clearml conf local cache to our mounted NAS drive (default_base_dir: "/nfs_client/.clearml/cache") download speed is ~50 times slower. Did anybody encountered this issue and or know how to fix it ?

  
  
Posted 3 months ago
Votes Newest

Answers 12


yes

  
  
Posted 3 months ago

running this command when cache is on /home/user/.clearml/cache took 5 seconds.
When the cache is on /nfs_client/.clearml/cache around 250 seconds.
wgetting the same data from gcp bucket to NFS drive 2.9 seconds.

  
  
Posted 3 months ago

Did you download the same data directly to the NAS and it took 5 secs?

  
  
Posted 3 months ago

We use the GCP SDK under the hood. Can you try downloading to the same folder in the NFS using GCP SDK?

  
  
Posted 3 months ago

yep. using clearml-data get --id MYID in both cases

  
  
Posted 3 months ago

Hi @<1648134232087728128:profile|AlertFrog99> , how is the download speed if you download directly to the NAS drive, unrelated to ClearML's cache

  
  
Posted 3 months ago

Fast. 20+Mb/sec

  
  
Posted 3 months ago

yes. Downloading small ds took 5 secs to local cache on home dir. On NAS took around 2-3 minutes

  
  
Posted 3 months ago

Did you try fetching the same data or from the same source?

  
  
Posted 3 months ago

gsutil -m cp -r "

gs://corsound-clear-ml-s3/cache/.datasets/debug_ds

" .

and it downloaded in 3 seconds

  
  
Posted 3 months ago

Did you download it to the same folder or to some mounter folder?

  
  
Posted 3 months ago

Via the SDK I assume?

  
  
Posted 3 months ago
177 Views
12 Answers
3 months ago
3 months ago
Tags