Hi DeliciousKoala34 . I was able to reproduce your issue. I'm now looking for a solution for your problem. Thank you
DeliciousKoala34 can you upgrade to clearml==1.8.0 ? the issue should be fixed now
The state folder is not affected
this is /mnt/machine_learning/datasets folder?
sorry, should have specified better
full path: /mnt/machine_learning/datasets/my-project/.datasets/cool-dataset/cool-dataset.7873a3b0764145f086a2af139c5f1fc9/artifacts
SmugDolphin23 Yes it works now! Thank you both very much for fast and great support!
And in that folder there are 5 data folders, I assume for every compressed chunk, and a state folder
So which data is being deleted? which folder is the “artifact folder”?
SmugDolphin23 Hello, sorry to bother, but are there any updates on this issue?
Hi DeliciousKoala34 ,
dataset on the share is deleted
the dataset task or the data in the folder? both shouldnt be deleted by get_local_copy activation
TimelyPenguin76
data in the folder, the dataset task is not deleted
which clearml version do you use?
The dataset is downloaded to my local clearml cache. But specifically all of the contents of the data folders, under artifacts folder are removed. The state folder is not affected.
can you try with the latest?pip install clearml==1.7.3rc1