digging deeper it seems like a parsing issue

helper is returned as None for some reason

s

good morning, I tried the script you provided and Im getting somewhere

It looks like im moving forward

Setting url in clearml.conf without "s3" as suggested works (But I dont add port ther, not sure if it breaks something, we dont have a port)
host: " our-host.com "

Then in test_task.py
task: clearml.Task = clearml.Task.init(
project_name="project",
task_name="task",
output_uri=" None ",
)

I think connection is created
What im getting now is bucket error, i suppose I have to specify it somewhere?

clearml.conf is a fresh one i did clearml-init to make sure

I do have write permissions

This is unrelated to your routers. There are two things at play here. The configuration of WHERE the data will go - output_uri and the other is the clearml.conf that you need to setup with credentials. I am telling you, you are setting it wrong. Please follow documentation.

maybe someone on your end can try to parse such a config and see if they also have the same problem

will it be appended in clearml?
"s3" is part of domain to the host

Hi @<1590514584836378624:profile|AmiableSeaturtle81> , any non-AWS S3-like storage must have a port in this setup, how did you configure the SDK?
Also the two ways you're showing are the same - the popup will fill in the details in the settings page

I think that the problem is with missing region definition. You need to set region in the config file.

But it looks like that for the existing version it will not work since there still appears to be a bug related to this. The hotfix is already on the way from my understanding

So, in short, you need to set the region in the config file + wait for the hotfix that is pending for 1.14

i need clearml.conf on my clearml server (in config folder which is mounted in docker-compose) or user PC? Or Both?
Its self hosted S3 thats all I know, i dont think it s Minio

host: "my-minio-host:9000"

Bump, still waiting, closing in on a month since we are unable to deploy. We have team of 10+ people

But there are stil some wierd issues, i cannot see the files uploaded in bucket

@<1523701435869433856:profile|SmugDolphin23> Any ideas how to fix this?

Hi @<1590514584836378624:profile|AmiableSeaturtle81> ! To help us debug this: are you able to simply use the boto3 python package to interact with your cluster?
If so, how does that code look like? This would give us some insight on how the config should actually look like or what changes need to be made.

This is the link generated

we do, yes. Changing it to https in settings doesnt help

there is a typing in clearm.conf i sent you on like 87, there should be "key" not "ey" im aware of it

The problem is that clearml.conf s3 config doesnt support empty region field, even empty strings crashes it

Yes, credetials seems to work
Im trying to figure out not why I dont see the uploaded files / folders

• I checked maybe clearml task uses fileserver instead but i dont see any files in fileserver folder
• Nothing is uploaded in bucket (i will ask IT guy to check if im uploading any files in logs)
  

Can you add your full configurations again?

it looks like problem is the host field, whenever I add it I get:
2024-01-22 13:27:16,489 - clearml.storage - ERROR - Failed creating storage object None Reason: Missing key and secret for S3 storage access ( None )

I know these keys work, url and everything else works because I use these creds daily

Setting these urls in SETTINGS/Configuration/ WEB APP CLOUD ACCESS in web ui
None doesnt work
None doesnt work
None doesnt work
None doesnt work
None gets replaced to None ://s3.host-our.com:8080 doesnt work
None doesnt work
None doesnt work

In all of these instances The S3 CREDENTIALS popup never dissapears, it will still popup always asking for creds no matter how I try to set the creds

• Here is how client side clearml.conf looks like together with the script im using to create the tasks. Uploads seems to work and is fixed thanks to you guys 🙌