Hi OutrageousSheep60 ! Regarding your questions:
No it's not. We will have a RC that fixes that ASAP, hopefully by tomorrow You can use add_external_files which you already do. If you wish to upload local files to the bucket, you can specify the output_url of the dataset to point the bucket you wish to upload the data to. See the parameter here: https://clear.ml/docs/latest/docs/references/sdk/dataset/#upload . Note that you CAN mix external_files and regular files. We don't have streaming capabilities in the datasets, but you could "partition" your download. Check the part and num_parts parameters here https://clear.ml/docs/latest/docs/references/sdk/dataset/#get_local_copy .