Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I’M Trying To Use Minio With Clearml As A External Storage. I Am Having Problems With The Configuration File For The Clearml Client When I Use The Output_Uri Parameter Of Task.Init What Do I Put There? I Am Currently Doing Task.Init(… Output_Uri=“S3://I

I’m trying to use minio with ClearML as a external storage. I am having problems with the configuration file for the ClearML client

When I use the output_uri parameter of Task.init what do I put there?

I am currently doing Task.init(… output_uri=“s3://ipaddr:9000/bucket-name”)

Specifically I’m getting the error “could not access credentials”

I have the default configuration file barring this change

Inside aws — > s3 — > credentials

I replaced host with

ipaddr:port

Key and secret with their appropriate values

secure: true

  
  
Posted one year ago
Votes Newest

Answers 31


@<1523701205467926528:profile|AgitatedDove14>
clearml python version: 1.91
python version: 3.9.15

the server is running the docker-compose on RHEL
Minio is on the same server and the 9000 and 9001 ports are open for tcp

I changed the default address space from 172.xxx.xxx.xx for docker to another space. This is not the issue as I can replicate this issue without this modified address space.

See configuration file below, I'm running the global section test now

    aws {
        s3 {
            # S3 credentials, used for read/write access by various SDK elements

            # The following settings will be used for any bucket not specified below in the "credentials" section
            # ---------------------------------------------------------------------------------------------------
            region: ""
            # Specify explicit keys
            key: ""
            secret: ""
            # Or enable credentials chain to let Boto3 pick the right credentials. 
            # This includes picking credentials from environment variables, 
            # credential file and IAM role using metadata service. 
            # Refer to the latest Boto3 docs
            use_credentials_chain: false
            # Additional ExtraArgs passed to boto3 when uploading files. Can also be set per-bucket under "credentials".
            extra_args: {}
            # ---------------------------------------------------------------------------------------------------


            credentials: [
                # specifies key/secret credentials to use when handling s3 urls (read or write)
                {
                #     # This will apply to all buckets in this host (unless key/value is specifically provided for a given bucket)
                     host: "***.***.**.***:9000"
                     key: "****************"
                     secret: "********************************"
                     multipart: false
                     secure: false
                }
            ]
        }
        boto3 {
            pool_connections: 512
            max_multipart_concurrency: 16
        }
    }
  
  
Posted one year ago