I think the idea is that end-users should access artifacts via the web interface. And jobs should run with the ClearML agent. Only configure clearml.conf
for the user account under which you are running your ClearML Agents, and only on the servers which are running your agents.
DashingKoala39 , you'll need to configure each server individually 🙂
DashingKoala39 for several users to share data, they would need to have access to the same bucket. Each user can configure their own clearml.conf when running stuff locally, and as AmiableFish73 mentioned, you usually configure agents once (with whatever access credentials and cloud storage you wish), and most of the time users will preview the results in the webapp (where they need to provide access credentials to cloud storage, usually read-only credentials)
Hi DashingKoala39 , some people prefer to use S3 or other storage solutions instead of the integrated fileserver. You can configure it on the clearml.conf
level and the task level
Ahh I see, I think I understand the workflow now, thanks!
Hi CostlyOstrich36 ! Thanks I appreciate the answer! When you say configure it on the clearml.conf level, that means then that this is a user-level configuration that each user of the server would need to individually configure, right? Or is there a way to configure this on the server so that when a new user makes a connection to the server, it gets automatically configured for them?
Thanks John! Though that does seem a little confusing as then anyone could really set up their own storage and wouldn't others potentially have difficulty accessing the artifacts if they needed to?