Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone. I’M Struggling To Setup Minio Storage. Below Is What I’M Adding In My Credentials And When I Try To Create A New Dataset Using Below Command; I Get Errors: Configs:

Hi everyone. I’m struggling to setup minio storage. Below is what I’m adding in my credentials and when I try to create a new dataset using below command; I get errors:

configs:

sdk {
    aws {
            s3 {
                # default, used for any bucket not specified below
                key: ""
                secret: ""
                region: ""
    
                credentials: [
                    {
                        # This will apply to all buckets in this host (unless key/value is specifically provided for a given bucket)
                        host: "ostore.xyz.tech"
                        key: "my_access_key"
                        secret: "my_secret_key"
                        multipart: false
                        secure: false
                    }
                ]
            } 
    }
}

command: clearml-data create --storage " None " --project dummyproject --name testingds1
Note: I’ve already created a bucket in minio named clearml

Error:

Error: Insufficient permissions (write failed) for 

Am I missing anything?
cc: @<1523701435869433856:profile|SmugDolphin23> could you please help?

  
  
Posted one year ago
Votes Newest

Answers 33


@<1709740168430227456:profile|HomelyBluewhale47> , how did you set the output_uri ?

  
  
Posted one year ago

Thanks a lot @<1523701070390366208:profile|CostlyOstrich36> emoji people:simple_smile 🙏

  
  
Posted one year ago

What is the combination of --storage and configuration that worked in the end?

  
  
Posted one year ago

image

  
  
Posted one year ago

Yup, tried that too.

  
  
Posted one year ago

sure

  
  
Posted one year ago

with the combination of None :port/bucket for --storage ?

  
  
Posted one year ago

it is picking http, it should https?

  
  
Posted one year ago

try None :port/bucket

  
  
Posted one year ago

Also a paste of your config

  
  
Posted one year ago

Hi John
Well, I didn’t setup anything extra 🙂

  
  
Posted one year ago

Removed port and set secure as true.

  
  
Posted one year ago

still got same error

  
  
Posted one year ago

FYI: I also changed the files_server in config

  
  
Posted one year ago

host: None

  
  
Posted one year ago

yes

  
  
Posted one year ago

Try only like this ostore.xyz.tech:9000

  
  
Posted one year ago

I also tried passing the default port for minio for host in config
eg: host: “ostore.xyz.tech:9000”

But getting same error.

  
  
Posted one year ago

raise ValueError(“Insufficient permissions (delete failed) for {}“.format(base_url))
ValueError: Insufficient permissions (delete failed) for None

  
  
Posted one year ago

Am I missing anything in config?

  
  
Posted one year ago

With what host config were you trying the last attempts?

  
  
Posted one year ago

Try running the following script

from clearml import Task 
import time

task = Task.init(output_uri="
")

print("start sleep")
time.sleep(20)
print("end sleep")

Please add the logs

  
  
Posted one year ago

clearml-data create --storage "
" --project dummyproject --name testingds1
clearml-data - Dataset Management & Versioning CLI
Creating a new dataset:

Error: Insufficient permissions (write failed) for ostore.xyz.tech
  
  
Posted one year ago

botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: “ None

  
  
Posted one year ago

I passed only None

  
  
Posted one year ago

Hi @<1523701070390366208:profile|CostlyOstrich36>
After removing the port number from command given by you.
Re: your message
with the combination of None :port/bucket for --storage ?

  
  
Posted one year ago

For below config and command it worked
command: clearml-data create --storage " None " --project dummyproject --name testingds2
image

  
  
Posted one year ago

Yes, I tried with default port of minio (9000). didn’t work either.

  
  
Posted one year ago

Yeah, I missed that you defined the storage with --storage please try with the port as well there

  
  
Posted one year ago

Again throwing Insufficient permissions.

  
  
Posted one year ago
122K Views
33 Answers
one year ago
one year ago
Tags
aws