The dataset is downloaded to my local clearml cache. But specifically all of the contents of the data folders, under artifacts folder are removed. The state folder is not affected.
TimelyPenguin76
data in the folder, the dataset task is not deleted
Hi DeliciousKoala34 ,
dataset on the share is deleted
the dataset task or the data in the folder? both shouldnt be deleted by get_local_copy activation
sorry, should have specified better
full path: /mnt/machine_learning/datasets/my-project/.datasets/cool-dataset/cool-dataset.7873a3b0764145f086a2af139c5f1fc9/artifacts
So which data is being deleted? which folder is the “artifact folder”?
And in that folder there are 5 data folders, I assume for every compressed chunk, and a state folder
can you try with the latest?pip install clearml==1.7.3rc1
The state folder is not affected
this is /mnt/machine_learning/datasets folder?
SmugDolphin23 Hello, sorry to bother, but are there any updates on this issue?
SmugDolphin23 Yes it works now! Thank you both very much for fast and great support!
Hi DeliciousKoala34 . I was able to reproduce your issue. I'm now looking for a solution for your problem. Thank you
DeliciousKoala34 can you upgrade to clearml==1.8.0 ? the issue should be fixed now
which clearml version do you use?