In which ui? Because there are two ways to do it. When clicking on artifacti url there is a popup (but has no way to change host url)
Our s3 host doesnt have port (didnt specify port in clearml.conf anywhere and upload works)
2024-02-08 11:23:52,150 - clearml.storage - ERROR - Failed creating storage object
Reason: Missing key and secret for S3 storage access (
)
(edited)
This looks unrelated, to the hotfix, it looks like you misconfigured something and therefor failing to write to s3
good morning, I tried the script you provided and Im getting somewhere
also, when uploading artifacts, I see where they are stored on the s3 bucket, but I cant find where the debug images are stored at
I know these keys work, url and everything else works because I use these creds daily
you might want to prefix both the host
in the configuration file and the uri in Task.init
/ StorageHelper.get
with s3.
if the script above works if you do that
Hi @<1590514584836378624:profile|AmiableSeaturtle81> , you need to setup your s3 key/secret in clearml.conf
I suggest following this documentation - None
unable to see the images with that link tho
@<1523701435869433856:profile|SmugDolphin23> Any news?
will it be appended in clearml?
"s3" is part of domain to the host
@<1590514584836378624:profile|AmiableSeaturtle81> weren't you using https for the s3 host? maybe the issue has something to do with that?
@<1523701070390366208:profile|CostlyOstrich36> Hello John, we are still unable to use clearml with our self hosted s3 CEPH instances, is there any update on the hotfix for 1.14?
Can you add your full configurations again?
i need clearml.conf on my clearml server (in config folder which is mounted in docker-compose) or user PC? Or Both?
Its self hosted S3 thats all I know, i dont think it s Minio
helper is returned as None for some reason
But there are stil some wierd issues, i cannot see the files uploaded in bucket
@<1590514584836378624:profile|AmiableSeaturtle81> , please see the section regarding minio in the documentation - None
clearml.conf is a fresh one i did clearml-init to make sure
Hi @<1590514584836378624:profile|AmiableSeaturtle81> , any non-AWS S3-like storage must have a port in this setup, how did you configure the SDK?
Also the two ways you're showing are the same - the popup will fill in the details in the settings page
@<1523701070390366208:profile|CostlyOstrich36> Hello, im still unable to understand how to fix this
We dont need a port
"s3" is part of url that is configured on our routers, without it we cannot connect
Again, I'm telling you, please look at the documentation and what it says specifically on minio like solutions.
The host should behost: "
our-host.com :<PORT>"
And NOThost: "
s3.our-host.com "
Maybe you don't require a port I don't know your setup, but as I said, in the host settings you need to remove the s3 as this is reserved only to AWS S3.