
Reputation
Badges 1
123 × Eureka!In which ui? Because there are two ways to do it. When clicking on artifacti url there is a popup (but has no way to change host url)
Our s3 host doesnt have port (didnt specify port in clearml.conf anywhere and upload works)
 or user PC? Or Both?
Its self hosted S3 thats all I know, i dont think it s Minio
Adding bucket in clearml.conf causes the same error: clearml.storage - ERROR - Failed uploading: Could not connect to the endpoint URL: " None "
.get_size()
@<1523701482157772800:profile|AnxiousSeal95> I see a lot of people here migrating data from one data source to another.
For us it was that we experimented with Clearml to get the feeling and we used clearml built in file storage to save debug images an all other artifacts.
Then we grew rapidly and we had to migrate to S3 storage.
I had to write a script that goes through elasticsearch and mongo db to point to new S3 links wher the data was migrated to.
I do however understand that migration...
Where can i override this so that it uses uv instead of trying to install python with apt
Can I do it while i have multiple ongoing training?
Here are my clearml versions and elastisearch taking up 50GB
ClearML team should really write up some tutorial about this. I see this question weekly now. The short answer on what we did when we migrated servers was to wite a python script that takes data from clearml mongodb(stores tasks and datasets) and elastic (stores debug image urls, logs, scalars) and migrate them to other clearml instance databases
It is also possible to just make a copy of all the database files and move them to another server
Bump, still waiting, closing in on a month since we are unable to deploy. We have team of 10+ people
Not really, but i think i will figure out the uv caching
I have another question @<1523701070390366208:profile|CostlyOstrich36>
How can i make the clearml agent to just run the image with just the uv
dont install any packages, nothing
i found docker_init_bash_script in clearml.config
i know there are some envs to pass in task init but that does not fully do what i want - just simply run the image, i have all the dependencies
Is fileserver folder needed for successful backup?
is there any way to see if I even have the data in mongodb?
This is what I see on fresh clearml
Where all my mounts are on /mnt/data/clearml-server instead of /opt/clearml
I get sidebars and login on my local PC
But the data isnt loaded
I tried to not edit anything in docker-compose and just paste my data in there. Didnt help
here is also another magic stuff
well, I connected to mongodb manually and it is empty, loaded with just examples
I guess I fucked up something when moving files
I get the same when I copy /opt/clearml/data folder into /mnt/data/clearml/data