Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Does Clearml Currently Support Access To Custom S3 Endpoints? If So, How Can We Do This?

Does ClearML currently support access to custom s3 endpoints? If so, how can we do this?

  
  
Posted 3 years ago
Votes Newest

Answers 8


let me check

  
  
Posted 3 years ago

I'm hoping to connect to the bucket inside of the VPC

  
  
Posted 3 years ago

AdventurousRabbit79 you mean like minio / ceph ?

  
  
Posted 3 years ago

Hi AdventurousRabbit79 , I'll take a look at it and get back to you - will probably be tomorrow 🙂

  
  
Posted 3 years ago

I'm looking for the same implementation, then I will check this. Thanks!

  
  
Posted 3 years ago

thanks so much Jake!! appreciate it

  
  
Posted 3 years ago

Hey AdventurousRabbit79 , from what I can see ( https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3-example-privatelink.html ), configuring boto3 to use these kind of endpoints is identical to configuring other S3-like interfaces (such as minio), so assuming you configure an entry in your clearml.conf configuration file (under aws.s3.credentials ) which includes the endpoint as the host (without the https schema) and with secure: true , it should work.
Note that as always what using an S3-like interface to upload files, you will have to specify the endpoint as the target (in the clearml.conf api.files_server field and/or as the output_uri , and make sure to use s3://<endpoint-hostname/bucket there and not https:// 🙂

  
  
Posted 3 years ago