SmugDolphin23 Where can I check the lates RC? I was not able to find it in the clearml github repo
SmugDolphin23 I'll be happy to checkout the RC once it is fixed
OutrageousSheep60 1.8.4rc1 is out. Can you please try it? pip install -U clearml==1.8.4rc1
hi OutrageousSheep60 ! We didn't release an RC yet, we will a bit later today tho. We will ping you when it's ready, sorry for the delay
Hi OutrageousSheep60 ! Regarding your questions:
No it's not. We will have a RC that fixes that ASAP, hopefully by tomorrow You can use add_external_files
which you already do. If you wish to upload local files to the bucket, you can specify the output_url
of the dataset to point the bucket you wish to upload the data to. See the parameter here: https://clear.ml/docs/latest/docs/references/sdk/dataset/#upload . Note that you CAN mix external_files and regular files. We don't have streaming capabilities in the datasets, but you could "partition" your download. Check the part
and num_parts
parameters here https://clear.ml/docs/latest/docs/references/sdk/dataset/#get_local_copy .