Fast. 20+Mb/sec

yes

yes. Downloading small ds took 5 secs to local cache on home dir. On NAS took around 2-3 minutes

gsutil -m cp -r "

gs://corsound-clear-ml-s3/cache/.datasets/debug_ds

" .

and it downloaded in 3 seconds

Via the SDK I assume?

Did you download it to the same folder or to some mounter folder?

Did you try fetching the same data or from the same source?

running this command when cache is on /home/user/.clearml/cache took 5 seconds.
When the cache is on /nfs_client/.clearml/cache around 250 seconds.
wgetting the same data from gcp bucket to NFS drive 2.9 seconds.

yep. using clearml-data get --id MYID in both cases

Hi @<1648134232087728128:profile|AlertFrog99> , how is the download speed if you download directly to the NAS drive, unrelated to ClearML's cache

We use the GCP SDK under the hood. Can you try downloading to the same folder in the NFS using GCP SDK?

Did you download the same data directly to the NAS and it took 5 secs?