Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey, When We Change In Our Clearml Conf Local Cache To Our Mounted Nas Drive (Default_Base_Dir: "/Nfs_Client/.Clearml/Cache") Download Speed Is ~50 Times Slower. Did Anybody Encountered This Issue And Or Know How To Fix It ?

Hey, when we change in our clearml conf local cache to our mounted NAS drive (default_base_dir: "/nfs_client/.clearml/cache") download speed is ~50 times slower. Did anybody encountered this issue and or know how to fix it ?

  
  
Posted 11 months ago
Votes Newest

Answers 12


Via the SDK I assume?

  
  
Posted 11 months ago

Fast. 20+Mb/sec

  
  
Posted 11 months ago

Did you try fetching the same data or from the same source?

  
  
Posted 11 months ago

yes. Downloading small ds took 5 secs to local cache on home dir. On NAS took around 2-3 minutes

  
  
Posted 11 months ago

We use the GCP SDK under the hood. Can you try downloading to the same folder in the NFS using GCP SDK?

  
  
Posted 11 months ago

Did you download it to the same folder or to some mounter folder?

  
  
Posted 11 months ago

Hi @<1648134232087728128:profile|AlertFrog99> , how is the download speed if you download directly to the NAS drive, unrelated to ClearML's cache

  
  
Posted 11 months ago

gsutil -m cp -r "

gs://corsound-clear-ml-s3/cache/.datasets/debug_ds

" .

and it downloaded in 3 seconds

  
  
Posted 11 months ago

yep. using clearml-data get --id MYID in both cases

  
  
Posted 11 months ago

yes

  
  
Posted 11 months ago

running this command when cache is on /home/user/.clearml/cache took 5 seconds.
When the cache is on /nfs_client/.clearml/cache around 250 seconds.
wgetting the same data from gcp bucket to NFS drive 2.9 seconds.

  
  
Posted 11 months ago

Did you download the same data directly to the NAS and it took 5 secs?

  
  
Posted 11 months ago
877 Views
12 Answers
11 months ago
11 months ago
Tags