Hi, We Are Using Clearml On Gcp K8S Using The Clearml-Helm-Charts, We Noticed That After Restarting The Apiserver Pod, The User Credentials We Added For The Secret.Credentials.Apiserver And Secret.Credentials.Tests In The Values.Yaml Are Being Deleted Any

Answered

Hi,
We are using clearml on gcp k8s using the clearml-helm-charts,
We noticed that after restarting the apiserver pod, the user credentials we added for the secret.credentials.apiserver and secret.credentials.tests in the values.yaml are being deleted
Any idea what we are doing wrong?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					ApprehensiveSeahorse83
				
					0
					 × 1

Votes Newest

Answers 31

we already using glue to manage our gpu pods. The agents we use for the pipelines are simple cpu agent.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					ApprehensiveSeahorse83
				
					0
					 × 1

Show more results

Write your answer

23K Views

31 Answers

2 years ago

8 months ago

Hi Everyone, I Have A Few Questions To Understand The Clearml-Serving A Little Better (And How Much Resources To Allocate For The Serving Pods): Are The Models I Defined To Be Served E.G. Via The Cli Downloaded To The Serving Pod? So That They Are Physica

Hi All! I Write A Data Processing Pipeline. It Is Necessary To Define Many Hyperparameters That Are Inconvenient To Redefine In A Pop-Up Window When Restarting The Pipeline From Ui. Is It Possible To Overrided The Parameters Through The Configuration File

Another Question, Can I Start A Clearml-Agent Inside A Docker Container (Part Of A Pod On A K8S-Cluster), And This Agent Would Then Pull Tasks From A Queue, But The Tasks Are Also Container-Based (Using A Different Container)?

Hello, I’Ve Enabled The Web Authentication For My Clearml Server And I’M Wondering Whether There’S A Way To Avoid Restarting All The Clearml Services Every Time A New User Is Added. For Example If Some Experiments Are Ongoing A New User Can’T Be Added Wit

Hi, Several Changes Occurred Recently And I Would Like To Know If There'S A Way To Verbose Catch All The Printout That Happening Within A K8S Glue Spawned Pod. We Have An Issue Where All Of Our New Remote_Execution Tasks Are Stuck In The 'Pending' Stage.

Hey! I Stumbled Upon Some Errors With My Workers Monitoring. I Checked Logs In My K8S Pods For Apiserver And Elasticsearch And It Seems The Problem Is There. These Are The Logs: Apiserver Logs [2021-04-23 06:19:50,209] [9] [Error] [Trains.Service_Repo] Re

Hi, We Are Running On Disconnected On Prem With A K8S Glue. When A Pod Is Spawned, We Noted That An Apt-Get Command Is Performed On The Pod. Short Of Changing The Content Of /Etc/Apt/Sources.List In The Images, Is There A Way For Clearml Agent To Override

Hey Guys The First Time I'M Seeing This Behavior I'M Adding A New User To /Opt/Trains/Config/Apiserver.Conf And Restarting The Containers. All Old Users Are Able To Log In, But Not The New One (Invalid User/Password Combination). Any Ideas?