thanks so much Jake!! appreciate it

I'm hoping to connect to the bucket inside of the VPC

let me check

Hey AdventurousRabbit79 , from what I can see ( https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-example-privatelink.html ), configuring boto3 to use these kind of endpoints is identical to configuring other S3-like interfaces (such as minio), so assuming you configure an entry in your clearml.conf configuration file (under aws.s3.credentials ) which includes the endpoint as the host (without the https schema) and with secure: true , it should work.
Note that as always what using an S3-like interface to upload files, you will have to specify the endpoint as the target (in the clearml.conf api.files_server field and/or as the output_uri , and make sure to use s3://<endpoint-hostname/bucket there and not https:// 🙂

https://docs.aws.amazon.com/vpc/latest/privatelink/vpce-interface.html

AdventurousRabbit79 you mean like minio / ceph ?

I'm looking for the same implementation, then I will check this. Thanks!

Hi AdventurousRabbit79 , I'll take a look at it and get back to you - will probably be tomorrow 🙂