When uploading the files, hash is being calculated for every entry, and this is done for the local files. so currently clearml-data support local files.
What would you like to do with the dataset? Why not using it directly from S3?
Why not using it directly from S3?
You can https://allegro.ai/clearml/docs/docs/examples/examples_storagehelper.html#downloading-a-file it with the