ClearML FAQ | Hi, I Have A Question About Logs, When I Am Looking Into Apiserver Logs, I Have For Example

Answered

Hi, I Have A Question About Logs, When I Am Looking Into Apiserver Logs, I Have For Example

Hi, I have a question about logs, when I am looking into apiserver logs, I have for example

[2023-04-18 14:47:42,043] [9] [INFO] [clearml.service_repo] Returned 200 for workers.unregister in 3ms

When worker is unregistered. Can I somehow get more data in the logs? For example - which worker is unregistered?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					RoundMosquito25
				
					0
					 × 1

Votes Newest

Answers 2

Ok, thanks!

  				
Posted 
	one year ago

					More
				  		
  Report
		
					RoundMosquito25
				
					0
					 × 1

Hi @<1523701240951738368:profile|RoundMosquito25> , full API logging is available for enterprise tiers (it's a pretty advanced and resource-consuming feature, as full logging is pretty heavy and take a lot of storage).
It's theoretically possible to add this kind of customization (at least for the server printouts), but it doesn't exist yet...

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Write your answer

946 Views

2 Answers

one year ago

one year ago

Tags

Similar posts

Hey, Everyone! Recently I Tried To Restore Clearml From Backup And Encountered Elastic Error. I Decided To Rule Out That Problem Is In Backup And Just Did Fresh Installation Of Clearml Without Backup Files. Problem Persisted. Apiserver Container Logs Read

Hey All! I Am Trying To Use The Clearml-Agent To Execute Tasks Scheduled In The Clearml Webui, However I Have Some Issues And I Was Wondering How The Agent Works Internally To Recreate An Image. In The Console Logs For Example:

Hi, I'M Using Lightgbm Package To Train Models. In My Task Execution I'M Getting Lots Of Warnings Print From Lightgbm. When Running Locally These Prints Are Not Occurring. How Can I Set Logging Level Of A Specific Package? Example Of The Logs:

Hi, Is There A Way To Put Scalars On The Same Plot? For Example: I Train A Model Using Pytorch-Lightning And The Clearml Logger Automatically Logs Both Training And Validation Loss. I'M Used To Looking At These Graphs On The Same Plot But The Scalars View

When I Send A Request Of Creating A User To Clearml-Apiserver, It Logs An Error Likes This:

Hi. I'M Using Clearml For Logging My Experiments. Can I Compare Experiments By Plotting Graphs? For Example, Every Experiment Logs The Time Per Training Iteration And The Accuracy Per Epoch. I Want To Create A Graph With "Average Time Per Iteration" As X-

With Clearml 1.0 It Seems That Console Logs Are Only Shown In The Web Ui When The Task Has Finished. Is This Expected Behaviour? With Previous Versions I Was Able To See "Live" Output. I Tested This With The Pytorch_Tensorboardx.Py Example. I Run The Scri

Hey! I Stumbled Upon Some Errors With My Workers Monitoring. I Checked Logs In My K8S Pods For Apiserver And Elasticsearch And It Seems The Problem Is There. These Are The Logs: Apiserver Logs [2021-04-23 06:19:50,209] [9] [Error] [Trains.Service_Repo] Re