Hi OutrageousSheep60
Do you mean something like:
https://github.com/allegroai/clearml/tree/master/examples/datasets
?

OutrageousSheep60 , I think you can take the file that you get, pickle it or zip it and then simply save it as a clearml dataset. What do you think?

Hi OutrageousSheep60 ,

I'm not sure I've seen such an example. But you can definately wrap torch dataset in clearml datasets. I am over simplifying but in the end think of the clearml dataset is like a large zip of all your files.

Possibly - thinking more of https://github.com/pytorch/data/blob/main/examples/vision/caltech256.py - using clearml dataset as root path.