Great question!
Actually I was wondering if ClearML had that integration possible from clearml-agent daemon requesting for temporary injection of required credentials from API-server which then requests Secret Manager. How does the Enteprrise version of ClearML currently do it when it has its own vault?
But I think I want to clarify something here after re-reading your message. My question is whether the API server can read credentials or weblogin password, username from something like Secret Manager rather than using a local file like secure.conf or apiserver.conf.
In this scenario, I assume this would have to be pulled somehow from the secret manager on a ClearML remote run - how would ClearML know which user's data should be pulled from the secret manager? I assume your remote executions are using the agent's docker mode?
Hi @<1523701132025663488:profile|SlimyElephant79> , where would you like this AWS Secret Manager data to be available and what would you like to use it for?
Hi @<1523701087100473344:profile|SuccessfulKoala55> , I'd like the Secret Manager to store the creds of the users & ClearML to utilize this instead of a file in a local directory. Or, we could also work with some options where the creds are stored within one of the databases that ClearML server already utilizes.
The AWS Secret Manager data would be within the accounts where we have set up the ClearML server in AMI/EC2 instances.