Hi OutrageousSheep60 ! Regarding your questions:
No it's not. We will have a RC that fixes that ASAP, hopefully by tomorrow You can use add_external_files which you already do. If you wish to upload local files to the bucket, you can specify the output_url of the dataset to point the bucket you wish to upload the data to. See the parameter here: https://clear.ml/docs/latest/docs/references/sdk/dataset/#upload . Note that you CAN mix external_files and regular files. We don't have streaming capabilities in the datasets, but you could "partition" your download. Check the part and num_parts parameters here https://clear.ml/docs/latest/docs/references/sdk/dataset/#get_local_copy .
SmugDolphin23 I'll be happy to checkout the RC once it is fixed
SmugDolphin23 Where can I check the lates RC? I was not able to find it in the clearml github repo
hi OutrageousSheep60 ! We didn't release an RC yet, we will a bit later today tho. We will ping you when it's ready, sorry for the delay
OutrageousSheep60 1.8.4rc1 is out. Can you please try it? pip install -U clearml==1.8.4rc1