To iterate and fill you in with some more info:

• The data is successfully uploaded to S:\Unfinished_Learning_Data\clearml-storage - I can see it in the file system.
• I am able to download the data with a clearml-data get --id xxxxxx command.
• When changing name of the NAS folder to S:\Unfinished_Learning_Data\clearml-storage-tempchanged, it is not possible to download data anymore - I get Error: Could not load Dataset id=xxxxxx state . This is good and expected.
• However, with the NAS folder name changed to S:\Unfinished_Learning_Data\clearml-storage-tempchanged, it is still possible to see a preview of the PNGs in the dataset in the ClearML app interface! Cache is disabled. This is very confusing to me. It makes me worried that I don't have control of my data.