Thanks @<1585078752969232384:profile|FantasticDuck7> , I'll make sure to fix that in the docker-compose deployment
I’m deploying my MinIO server on local network, and the URL to it contains port 9000, when I setup clearml to sync data to the storage, I have to set default output uri to sdk.development.default_output_uri="
None "
And the rest of my config will look like the image below. Is there anything I have to config in my clearml server on default output uri (for example the bucket name or port…)?
Hi! I've faced the same problem and solved it like in this thread
The latest server version should be able to support it, but you need to configure the required credentials sin the server configuration for the server to be able to delete these files
In short - you have to map config folder to async_delete container like in apiserver container.
Hi @<1603198153677344768:profile|ExasperatedSeaurchin40> , I assume you're using a self-hosted server?
Yes, I already config it and I seeing that my files are being uploaded on MinIO. But when I delete project on clearML, it does not remove files in MinIO
For the server to be able to delete these files, you need to set up the same credentials on the server side, not just on the client side
Yes, I self-host a clearml server and minio as well
You can put it under /opt/clearml/config/services.conf
and inside the keys specified in the file need to be inside the storage_credentials { }
section
Hmm, let me check that again. Is that storage config file goes into /opt/clearml/config?
@<1523701087100473344:profile|SuccessfulKoala55> I already try to setup bucket which point to clearmlstorage but it didn’t work
No no, the upload is done on the client side. This is for the server
@<1523701087100473344:profile|SuccessfulKoala55> @<1585078752969232384:profile|FantasticDuck7> Thank you very much. It works now 😊
yes, I upload on the client, but the information about dataset is manage on the clearml server right?