Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey All. Question About The Bucket Config For Clearml. Is It Possible To Have Two Buckets In The Config? We Have Partners In Eu And Us, And Due To Data Governance Legislation, We Cannot Store All The Data In One Bucket. Any Insights?

Hey all. Question about the bucket config for clearml. Is it possible to have two buckets in the config? We have partners in EU and US, and due to data governance legislation, we cannot store all the data in one bucket. Any insights?

  
  
Posted 2 years ago
Votes Newest

Answers 6


Hi TenseOstrich47 ,

Try using aws credentials with region too https://github.com/allegroai/clearml/blob/master/docs/clearml.conf#L88

credentials: [ specifies key/secret credentials to use when handling s3 urls (read or write) { bucket: "my-bucket-name" key: "my-access-key" secret: "my-secret-key" region: "my-region" },

  
  
Posted 2 years ago

great, thanks! will give that a go

  
  
Posted 2 years ago

So how do I ensure that artefacts are uploaded in the correct bucket from within clearml?

  
  
Posted 2 years ago

whats the specific scenario? are you running and using both buckets in the same run? each run different bucket?

  
  
Posted 2 years ago

each run in a different bucket

  
  
Posted 2 years ago

TenseOstrich47 the artifacts are uploaded to the bucket according to the output_uri you provide, ClearML will not automatically upload to any bucket just because the configuration contains credentials for it

  
  
Posted 2 years ago
498 Views
6 Answers
2 years ago
one year ago
Tags