Hi, I attached an IAM role to an ec2 instance to grant access to an s3 bucket. The ec2 instance is running a clearml-agent (v1.1.0). I didn’t specify any key/secret for clearml. The tasks fail with the following error:
2021-10-18 08:21:10,853 - clearml.storage - ERROR - Failed creating storage object
Reason: Missing key and secret for S3 storage access (
) Traceback (most recent call last): File "devops/train.py", line 73, in <module> train(parse_args) File "devops/train.py", line 37, in train train_task.get_logger().set_default_upload_destination(args.artifacts + '/clearml_debug_images/') File "/root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages/clearml/logger.py", line 1038, in set_default_upload_destination uri = storage.verify_upload(folder_uri=uri) AttributeError: 'NoneType' object has no attribute 'verify_upload'If I connect to the ec2 instance and just do
aws s3 ls customs-artefacts , I can see all the files, so the CLI is able to access the s3 bucket, but not clearml. How can I make this setup work?
Note: In the clearml.conf, I’ve set
sdk.aws.s3.region = eu-central-1 , so the logs for the failing task is as follows:
... sdk.aws.s3.key = sdk.aws.s3.region = eu-central-1 ...