MagnificentSeaurchin79 how do you call download_folder
? Can you share an example?
not sure, I'm using GCS not S3. Is download_folder
doing something different than downloading all files inside the folder?
Hi MagnificentSeaurchin79 , is this related? https://clearml.slack.com/archives/CTK20V944/p1640125038120200?thread_ts=1640101034.114100&cid=CTK20V944
the issue is with StorageManager.download_folder
If I download each file in the folder using StorageManager.get_local_copy(remote_url=gs_url)
, it works OK