I also see that elastisearch and mongo has some data

I was on 1.7 version and now im on latest 1.11
Cant get screenshow yet (copying data), will add later.
What worries me is that config and agent folders are empty. I can reconfigure all agents, no problems.
But where is info about projects stored?

Not really, but i think i will figure out the uv caching

I have another question @<1523701070390366208:profile|CostlyOstrich36>
How can i make the clearml agent to just run the image with just the uv
dont install any packages, nothing
i found docker_init_bash_script in clearml.config
i know there are some envs to pass in task init but that does not fully do what i want - just simply run the image, i have all the dependencies

I get sidebars and login on my local PC
But the data isnt loaded

I tried to not edit anything in docker-compose and just paste my data in there. Didnt help

Im pretty sure

ok, I found it.
Are S3 links supported?

will it be appended in clearml?
"s3" is part of domain to the host

@<1523701070390366208:profile|CostlyOstrich36> Hello John, we are still unable to use clearml with our self hosted s3 CEPH instances, is there any update on the hotfix for 1.14?

Hey, i see that 1.14.2 dropped
I tried it but the issue is still there, maybe the hotfix is in next patch?

Here is the setup so you can reproduce it (we dont have region field)
clearml.conf:
s3 {
use_credentials_chain: false
credentials: [
{
host: " s3.somehost.com "
key: "XXXXXXXXXXXXXXXXXXXX"
` secret: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...

It looks like im moving forward

Setting url in clearml.conf without "s3" as suggested works (But I dont add port ther, not sure if it breaks something, we dont have a port)
host: " our-host.com "

Then in test_task.py
task: clearml.Task = clearml.Task.init(
project_name="project",
task_name="task",
output_uri=" None ",
)

I think connection is created
What im getting now is bucket error, i suppose I have to specify it so...

removing it doesnt fix the problem

@<1523701070390366208:profile|CostlyOstrich36> It it still needed since Eugene thinks there is a bug?

But there are stil some wierd issues, i cannot see the files uploaded in bucket

s

also, if I try to set the url to None it auto replaces it with None : None

7 out of 30 GB is currently used and is quite stable

@<1523701435869433856:profile|SmugDolphin23> Any ideas how to fix this?

I solved the problem.
I had to add tensorboard loggger and pass it to pytorch_lightning trainer logger=logger
Is that normal?

Sounds similar to our issue? We have self hosted S3
None

Is it possible to split the large elasticsearch indexes? I know elasticsearch has something called rollover, but im not sure that clearml supports this

No, i specify where to upload
I see the data on S3 bucket is beeing uploaded. Just the log messages are really confusing

ok, is dataset path stored in mongo?
Im unable to find it in elasticsearch (debug images were here)

doesnt help

You can check out boto3 python client (This is what we use to download / upload all S3 stuff), but minio-client probably already uses it under the hood.
We also use aws cli to do some downloading, it is way faster than python.

Regarding pdfs, yes, you have no choice but to preprocess it

well, I connected to mongodb manually and it is empty, loaded with just examples

We fixed the issue, thanks, had to update everything to latest.

How can I do that?
I need to save the original hash, otherwise I lose all trackability to about 2k experiments

Bump, still waiting, closing in on a month since we are unable to deploy. We have team of 10+ people

it looks like problem is the host field, whenever I add it I get:
2024-01-22 13:27:16,489 - clearml.storage - ERROR - Failed creating storage object None Reason: Missing key and secret for S3 storage access ( None )