@<1523701087100473344:profile|SuccessfulKoala55> I already try to setup bucket which point to clearmlstorage but it didn’t work
Hmm, let me check that again. Is that storage config file goes into /opt/clearml/config?
@<1523701087100473344:profile|SuccessfulKoala55> @<1585078752969232384:profile|FantasticDuck7> Thank you very much. It works now 😊
I’m deploying my MinIO server on local network, and the URL to it contains port 9000, when I setup clearml to sync data to the storage, I have to set default output uri to sdk.development.default_output_uri=" None "
And the rest of my config will look like the image below. Is there anything I have to config in my clearml server on default output uri (for example the bucket name or port…)?
No no, the upload is done on the client side. This is for the server
You can put it under /opt/clearml/config/services.conf and inside the keys specified in the file need to be inside the storage_credentials { } section
Hi @<1603198153677344768:profile|ExasperatedSeaurchin40> , I assume you're using a self-hosted server?
The latest server version should be able to support it, but you need to configure the required credentials sin the server configuration for the server to be able to delete these files
Yes, I already config it and I seeing that my files are being uploaded on MinIO. But when I delete project on clearML, it does not remove files in MinIO
In short - you have to map config folder to async_delete container like in apiserver container.
Thanks @<1585078752969232384:profile|FantasticDuck7> , I'll make sure to fix that in the docker-compose deployment
For the server to be able to delete these files, you need to set up the same credentials on the server side, not just on the client side
yes, I upload on the client, but the information about dataset is manage on the clearml server right?
Yes, I self-host a clearml server and minio as well
Hi! I've faced the same problem and solved it like in this thread