Hi Community, Using Clearml And Loving It So Far! I Had A Question Around The Models That Clearml Automatically Picks Up From The Frameworks And Saves Them. Is There A Way That I Can Control Which Models Actually Get Saved Though? I Would Like To Save Onl

Answered

Hi Community, using ClearML and loving it so far! I had a question around the Models that ClearML automatically picks up from the frameworks and saves them. Is there a way that I can control which models actually get saved though? I would like to save only the last & best checkpoints and not all of them if possible. Checking the documentation for Model, InputModel, and OutputModel, I couldn't see any control that would let me do that. Any suggestions here?

Saving things for archaelogy is important, but I think I would also end up bloating the system.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SlimyElephant79
				
					0
					 × 1

Votes Newest

Answers 2

@<1523701205467926528:profile|AgitatedDove14> this worked and gave me what I exactly needed. Thanks.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SlimyElephant79
				
					0
					 × 1

Hi @<1523701132025663488:profile|SlimyElephant79>

I would like to save only the last & best checkpoints and not all of them if possible.

Basically it will mimic the local file system, so if you overwrite the local files it will overwrite the remote model.
You can also disable auto logging, and manually upload the models
In Task.init pass auto_connect_frameworks False for the specific framework
see:
None

then use task.update_output_model or OutputModel class
None

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Write your answer

1K Views

2 Answers

one year ago