Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, I Have A Question I Am Trying To Connect Clearml To Local Minio But For Some Reason The Host Configuration Is Dropped Out, I Tried To Go In To The Code To Print Out The Config Throughout The Different Steps And I Get This [S3Bucketconfig(Bucket='In

Hello, I have a question
I am trying to connect Clearml to local minio but for some reason the Host configuration is dropped out,
I tried to go in to the code to print out the config throughout the different steps and I get this
[S3BucketConfig(bucket='inference', subdir='', host='localhost:9090', key='12345678', secret='12345678', token='', multipart=False, acl='', secure=False, region='', verify=True, use_credentials_chain=False, extra_args=None)]
but then after that I get
S3BucketConfig(bucket='inference', subdir='', host='', key='123456', secret='123456', token='', multipart=True, acl='', secure=True, region='ae-ad-1', verify=True, use_credentials_chain=False, extra_args=ConfigTree())
where host is dropped out.
it is happenning specifically after the command
self._s3_configurations.get_config_by_uri(url)

  
  
Posted one year ago
Votes Newest

Answers 6


aws {
s3 {
# S3 credentials, used for read/write access by various SDK elements

        # The following settings will be used for any bucket not specified below in the "credentials" section
        # ---------------------------------------------------------------------------------------------------
        region: "ae-ad-1"
        # Specify explicit keys
        key: "123456"
        secret: "123456"
        bucket: " [None](s3://inference) "
        # Or enable credentials chain to let Boto3 pick the right credentials.
        # This includes picking credentials from environment variables,
        # credential file and IAM role using metadata service.
        # Refer to the latest Boto3 docs
        use_credentials_chain: false
        # Additional ExtraArgs passed to boto3 when uploading files. Can also be set per-bucket under "credentials".
        extra_args: {}
        # ---------------------------------------------------------------------------------------------------


        credentials: [
            # specifies key/secret credentials to use when handling s3 urls (read or write)
            # {
            #     bucket: "my-bucket-name"
            #     key: "my-access-key"
            #     secret: "my-secret-key"
            # },
            {
                # This will apply to all buckets in this host (unless key/value is specifically provided for a given bucket)
                bucket: "inference"
                host: "localhost:9090"
                key: "12345678"
                secret: "12345678"
                multipart: false
                secure: false
            }
        ]
    }
    boto3 {
        pool_connections: 512
        max_multipart_concurrency: 16
    }
}
  
  
Posted one year ago

and what is --storage s3//:inference ?
if you are using minio it should be something like None
Notice you have to specify the IP:port otherwise it thinks it is an AWS endpoint

  
  
Posted one year ago

Ohh! now it works! thank you so much @<1523701205467926528:profile|AgitatedDove14> !!

  
  
Posted one year ago

this is my configuration

  
  
Posted one year ago

in the command I specify the following
--storage s3//:inference

  
  
Posted one year ago

Hi @<1559711593736966144:profile|SoggyCow20>
How did you configure the clerml.conf ? see here an example:
None

  
  
Posted one year ago
924 Views
6 Answers
one year ago
one year ago
Tags