And you get the error only when there are no credentials or is this unconnected?
I have set default_output_uri to s3://my_minio_instance:9000/clearml
If I set files_server to s3://my_minio_instance:9000 /bucket_that_does_not_exist it fails at uploading metrics, but model upload still works:
WARNING - Failed uploading to s3://my_minio_instance:9000/ bucket_that_does_not_exist ('NoneType' object has no attribute 'upload')
clearml.Task - INFO - Completed model upload to s3://my_minio_instance:9000/clearml
What is default_output_uri for? Only artifact upload?
default_output_uri is for artifacts & models while files_server is for debug samples and plots (if they are files)
I can put anything there: s3://my_minio_instance:9000 /bucket_that_does_not_exist and it will work.
Just if I leave it empty, it will not work.
These are the errors I get if I use file_servers without a bucket ( s3://my_minio_instance:9000 )
2022-11-16 17:13:28,852 - clearml.storage - ERROR - Failed creating storage object Reason: Missing key and secret for S3 storage access ( ) 2022-11-16 17:13:28,853 - clearml.metrics - WARNING - Failed uploading to ('NoneType' object has no attribute 'upload_from_stream') 2022-11-16 17:13:28,854 - clearml.storage - ERROR - Failed creating storage object Reason: Missing key and secret for S3 storage access ( )But for the same run model upload works:2022-11-16 17:13:28,928 - clearml.storage - INFO - Starting upload: /tmp/.clearml.upload_model_m33vzdf7.tmp => my_minio_instance:9000/clearml/mymodel.pth 2022-11-16 17:13:28,974 - clearml.Task - INFO - Completed model upload to
Hi ReassuredTiger98 , I'm not sure I understand.
You're asking why you need to put in credentials to use minio as a files_server or why you got the error directly on port 9000 but not on s://minio_instance:9000/ <MY_BUCKET_NAME> ?