Reputation
Badges 1
14 × Eureka!Yes, "from clearml import StorageManager"
Hi SuccessfulKoala55 ,
Thank you for your help. It is working now after I removed the ports for ElasticSearch, Redis, and MongoDB. I am using HTTP at the moment because HTTPS doesn't work, how should I change the rules? How can I restart the Trains Server on EC2?
Sure. BTW, I also put the screenshot of the config for the security group (I understand it should not be open to the whole world, I'm just setting up first, and someone else will help me to update the rules later).
We actually want to set the output_uri in Task.init to be a folder in AWS S3. And run the script on sagemaker.
Hi TimelyPenguin76 , I added the AWS_DEFAULT_REGION as well, and it did not work. The version of ClearML is '0.17.4'.
TimelyPenguin76 Unfortunately, no. Is the error because of token?
Hi TimelyPenguin76 , I tried and got the same error as before. One thing was different from yours, our company is using SSO to access AWS, so I added os.environ['AWS_SESSION_TOKEN'] = "***". It worked for boto3 to upload the file to S3, so I think probably SSO is not the reason.
Hey TimelyPenguin76 Any luck?
It is working now, thank you very much for your help.
Hi TimelyPenguin76 , any update?
Hi Jake, I've solved the issue, it was caused by our company's network security restrictions, thank you.
Hi TimelyPenguin76 , Thank you for your reply, I've tried env vars. The problem happened when I tried to upload the files to S3 using ClearML. os.environ['AWS_ACCESS_KEY_ID'] = "***"
os.environ['AWS_SECRET_ACCESS_KEY'] ="***"
os.environ['AWS_SESSION_TOKEN'] = "***"
I used boto3 to upload and it worked means the key should be right. But it did not work when using clearml.