my config is same like issue #763
` import clearml
from clearml import StorageManager, Dataset
from rich import print
version_clearml = clearml.version
manager = StorageManager()
print(f'clearml: {version_clearml}')
try:
minio_s3_url = 'x/x/x/x/x/x/x'
print('\n-------------download folder-------------')
target_folder = manager.download_folder(
local_folder='tmp',
remote_url=f' '
)
except Exception as e:
print(e)
print('FAILED: download folder') `
Hi SuccessfulKoala55 , after i tried from version 1.7.2 to newest 1.8.3, but failed. Sorry i forgot what version i tried, but possiblly 1.7.3rc0, but it also failed today.
Hi AgitatedDove14 , yeah, my config is same like issue #763
Hi SmugDolphin23 , like issue reported on github, i tried using boto3 and works.
maybe accidently install my custom solution on this https://github.com/muhammadAgfian96/clearml/commit/01db9aa40537a6c2f83977220423556a48614c3a at that time. so i said the test is passed.
Hi QuaintJellyfish58 , did this work in the previous version and stop working now?
QuaintJellyfish58 Notice it tries to access AWS not your minio"
This seems like a bug?! can you quickly verify with previous version ?
Also notice you have to provide the minio section in the clearml.conf so it knows how to access the endpoint:
https://github.com/allegroai/clearml/blob/bd53d44d71fb85435f6ce8677fbfe74bf81f7b18/docs/clearml.conf#L113
hi QuaintJellyfish58 ! How does your clearml.conf
look like? How do you run minio
? Can you download files using boto3
rather than clearml
? Could you provide a script that could help us reproduce the issue?
Hi SmugDolphin23 , i have try 1.8.4rc1, and yeah its working! Thanks!
QuaintJellyfish58 We will release later today an RC that adds the region to boto_kwargs
. We will ping you when it's ready to try it out