Hi, I know that if you have a child dataset of a dataset with zips, and if the parent has been cached locally, the files in the zips would be symlinked to the parent's in child.get_local_copy() . But now I have a child dataset of a dataset with external files. When I call child.get_local_copy() , even though I have the parent already downloaded in the cache, the child.get_local_copy() redownloads all external files that it inherited from the parent. Is this intended behavior?
child-ext local cache (without a symlink to the parent):
Hi ScatteredPeacock14 ! I think you are right. We are going to look into fixing this
Hi ScatteredPeacock14 , can you provide a sample script that reproduces this behavior? What version of the SDK are you using?
Here's a minimal example running on ClearML 1.16.1:
