Hi! We Use Clearml Self-Hosted On A K8S Cluster. I Currently Try To Reduce The Log Level Of The Clearml Components Such As The Apiserver, Fileserver, Webserver And Clearml Serving. What I Found Is

Answered

Hi! We use ClearML self-hosted on a k8s cluster.

I currently try to reduce the log level of the ClearML components such as the Apiserver, Fileserver, Webserver and ClearML Serving. What I found is None but as far as I understand it the log level set by CLEARML_LOG_LEVEL is only effecting the logging of the SDK itself and not e.g. the log level of the Apiserver. I also did not find any environment variables for this to be set in the helm charts. Is there any documentation on how to set the log level for these components?

  				
Posted 
	3 months ago

					More
				  		
  Report
		
					RattySparrow90
				
					0
					 × 1

Votes Newest

Answers 4

Hey @<1649221394904387584:profile|RattySparrow90> - You can try configuring CLEARML__logging__root__level as an extraEnvs for the apiserver and fileserver 🙂

  				
Posted 
	3 months ago

					More
				  		
  Report
		
					CooperativeKitten94
				
					0

value can be DEBUG, INFO, WARNING, ERROR, CRITICAL

  				
Posted 
	3 months ago

					More
				  		
  Report
		
					CooperativeKitten94
				
					0

@<1729671499981262848:profile|CooperativeKitten94> Thanks again for your help, the number of logs are now reduced significantly 👍 . A short follow up question: Can I somehow control the log level of the agent/worker in the k8s cluster? Any environment variable I can set or add to there? I digged a bit into the code of the agent and for me it seems that the log level is hard-coded to 'INFO'. Is this correct?

  				
Posted 
	one month ago

					More
				  		
  Report
		
					RattySparrow90
				
					0
					 × 1

@<1729671499981262848:profile|CooperativeKitten94> Perfect, thanks. Will try this out

  				
Posted 
	3 months ago

					More
				  		
  Report
		
					RattySparrow90
				
					0
					 × 1

Write your answer

269 Views

4 Answers

3 months ago

one month ago