I.e. how are you creating the dataset and how you are trying to retrieve it
AdorableCrocodile14 any file starting with file:// is considered a direct access path by default
Can you provide a code example of what you're doing?
SuccessfulKoala55 The following is how I create the dataset and how I am trying to retrieve it. Is there any other way to retrieve, without actually download dataset (copying) and use the direct link access
My cache folder is /mnt/ssd2t/clearml
Hi AdorableCrocodile14 ! get_local_copy will always copy/download external files to a folder. To get the external files, there is property on the dataset called link_entries which returns a list of LinkEntry objects, which contain a link attribute, and each such link should point to a extrenal file (in this case, your local paths prefixed with file:// )
SmugDolphin23 Great, I am able to do it now. Thank you so much 🙇