Reputation
Badges 1
14 × Eureka!We actually want to set the output_uri in Task.init to be a folder in AWS S3. And run the script on sagemaker.
Hey TimelyPenguin76 Any luck?
Hi SuccessfulKoala55 ,
Thank you for your help. It is working now after I removed the ports for ElasticSearch, Redis, and MongoDB. I am using HTTP at the moment because HTTPS doesn't work, how should I change the rules? How can I restart the Trains Server on EC2?
Hi TimelyPenguin76 , I tried and got the same error as before. One thing was different from yours, our company is using SSO to access AWS, so I added os.environ['AWS_SESSION_TOKEN'] = "***". It worked for boto3 to upload the file to S3, so I think probably SSO is not the reason.
Hi TimelyPenguin76 , Thank you for your reply, I've tried env vars. The problem happened when I tried to upload the files to S3 using ClearML. os.environ['AWS_ACCESS_KEY_ID'] = "***"
os.environ['AWS_SECRET_ACCESS_KEY'] ="***"
os.environ['AWS_SESSION_TOKEN'] = "***"
I used boto3 to upload and it worked means the key should be right. But it did not work when using clearml.
Hi TimelyPenguin76 , any update?
It is working now, thank you very much for your help.
Hi Jake, I've solved the issue, it was caused by our company's network security restrictions, thank you.
Sure. BTW, I also put the screenshot of the config for the security group (I understand it should not be open to the whole world, I'm just setting up first, and someone else will help me to update the rules later).
Yes, "from clearml import StorageManager"
TimelyPenguin76 Unfortunately, no. Is the error because of token?
Hi TimelyPenguin76 , I added the AWS_DEFAULT_REGION as well, and it did not work. The version of ClearML is '0.17.4'.