I Know I’Ve Seen This Issue Pop Up In The Slack Before, But I Couldn’T Find It After Searching. I’Ve Got Some Code That Starts A New Task. The Task Shows Up In The Clearml Web Interface, But When The Task Finishes, It Is Never Marked As “Completed”. It S

Answered

i know i’ve seen this issue pop up in the slack before, but I couldn’t find it after searching.

I’ve got some code that starts a new task. the task shows up in the clearML web interface, but when the task finishes, it is never marked as “completed”. it stays in the “running” state for a while and then eventually changes to “aborted”. I’m not totally certain why this would be. any thoughts?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NastyFox63
				
					0
					 × 1

Votes Newest

Answers 7

will give it a try. thanks 🙂

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NastyFox63
				
					0
					 × 1

hmmm, i’m not creating the task in __main__ , i wonder if that’s why

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NastyFox63
				
					0
					 × 1

Hi @<1559349204206227456:profile|BeefyStarfish55> , how did you run the task? I assume it's not running by an agent

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I think the easiest way is to call mark_stopped() when your code is done

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

apologies, I mean mark_completed() 😆

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

2023-05-06 12:05:49,168 - clearml.Task - WARNING - ### TASK STOPPED - USER ABORTED - STATUS CHANGED ###

lol.
this changes the status in the UI to “aborted”.

not ideal, but if the answer is “for this to work, tasks must be run by an agent” i accept it

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NastyFox63
				
					0
					 × 1

correct, i’m just running the task via CLI

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NastyFox63
				
					0
					 × 1

Write your answer

996 Views

7 Answers

one year ago