ClearML FAQ | Hey Everyone, I'M New To Clear Ml, But My Company Is Looking At Rolling It Out On Our Eks Cluster. We'Ve Installed Everything Through The

Answered

Hey Everyone, I'M New To Clear Ml, But My Company Is Looking At Rolling It Out On Our Eks Cluster. We'Ve Installed Everything Through The

Hey everyone, I'm new to clear ml, but my company is looking at rolling it out on our EKS cluster. We've installed everything through the helm charts and have multiple engineers who are hoping to use one deployment, however I am having some trouble understanding how to best attribute tasks to individual users, especially when they are created via a pipeline.

It seems to me that when a pipeline is created, the user is set to whomever created the pipeline. But when a task within that pipeline is created, the user is set to the clearml agent which ran the pipeline (although the creator can still be set to the pipeline user). Beyond wondering if I have this correct, is there any way to set the user as the creator of the pipeline instead of the agent who executed the task? Would it be recommended to create one agent for each user and just utilize their credentials?

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					PerplexedDog0
				
					0
					 × 1

Votes Newest

Answers 2

Thank you very much @<1523701070390366208:profile|CostlyOstrich36> for your response. This looks like exactly what we are looking for! I'm confused though if there is any way to apply this to a clear-ml agent who was created through the helm chart though. Would I just pass this in as an Env variable?

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					PerplexedDog0
				
					0
					 × 1

Hi @<1841649351697371136:profile|PerplexedDog0> , I think what you're looking for is impersonation of the agent during execution. This can be achieved via the --use-owner-token flag when running the agent - None

  				
Posted 
	2 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

417 Views

2 Answers

2 months ago

2 months ago

Tags

Similar posts

Hi, I Am Trying To Set Up The Gcp Autoscaler. I Created A Gcp Service Account And Granted It The Following Roles: Compute Admin, Service Account User, And Logs Writer. I Then Added Its Credentials Under The Gcp Credentials Section In Clearml. Vm Instanc

Hi Folks! I Am Creating A Pipeline Using Decorators. The First Step Of The Pipeline Is Downloading And Processing The Dataset. Inside The Step Function, There Is A Clearml Import: From Clearml Import Dataset. However, For Some Reason In The Created Envir

Hello, In My Teams Workspace (In The Web Ui) If I Remove A User/Delete It, Do I Lose The Data That User Created In That Workspace (Experiments, Artifacts, Etc). Thanks

Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin

Hi Everyone ! I'M Working With Pipelinecontroller. Is It Possible To Create A Pipeline With Optional Steps ? To Clarify I Add An Example Of A Pipeline In The Picture. For Example, The User Would Be Able To Modify The Value Of A Parameter To Execute The St

Hi Again, I Am Trying To Execute A Pipeline Remotely, However I Am Running Into A Problem With The Steps That Require A Local Package. Basically I Have A Repo, That I Created Specifically For This Pipeline And I Have Packaged It So That I Can Split It I

Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Hi All, I Have A Query Regarding The Retrieval Of Pipeline Details. I Have Already Created A Pipeline Under The Project Name "<Project_Name>" And The Pipeline Name Is "<Pipeline_Name>". I Would Like To Retrieve The Version Of This Pipeline. I Tried Using

Hello Everyone, We Have Created A Cleaml Pipeline Using Pipelinecontroller. We Use Add_Function_Step To Add Tasks To The Pipeline. So As To Upload Artifacts Etc. Directly To S3 Bucket We Assign Bucket Path To The Output_Uri Parameter In The Add_Function_

We Do Want To Have Control Which Files Are Logged In The Model Registry. There Is Such Option In Task.Init(), Auto_Connect_Frameworks=False Or Injecting A Dict() To It.. But Our Tasks Are Created As Being Part Of A Pipeline With Add_Function_Step(). So We