Hi @<1603198153677344768:profile|ExasperatedSeaurchin40> , I assume you're using a self-hosted server?
Yes, I self-host a clearml server and minio as well
Yes, I already config it and I seeing that my files are being uploaded on MinIO. But when I delete project on clearML, it does not remove files in MinIO
yes, I upload on the client, but the information about dataset is manage on the clearml server right?
@<1523701087100473344:profile|SuccessfulKoala55> @<1585078752969232384:profile|FantasticDuck7> Thank you very much. It works now 😊
No no, the upload is done on the client side. This is for the server
I’m deploying my MinIO server on local network, and the URL to it contains port 9000, when I setup clearml to sync data to the storage, I have to set default output uri to sdk.development.default_output_uri=" None "
And the rest of my config will look like the image below. Is there anything I have to config in my clearml server on default output uri (for example the bucket name or port…)?
You can put it under /opt/clearml/config/services.conf and inside the keys specified in the file need to be inside the storage_credentials { } section
@<1523701087100473344:profile|SuccessfulKoala55> I already try to setup bucket which point to clearmlstorage but it didn’t work
For the server to be able to delete these files, you need to set up the same credentials on the server side, not just on the client side
In short - you have to map config folder to async_delete container like in apiserver container.
Hi! I've faced the same problem and solved it like in this thread
Thanks @<1585078752969232384:profile|FantasticDuck7> , I'll make sure to fix that in the docker-compose deployment
Hmm, let me check that again. Is that storage config file goes into /opt/clearml/config?
The latest server version should be able to support it, but you need to configure the required credentials sin the server configuration for the server to be able to delete these files