Hey, I Was Planning To Save The Best Trained Model And Get A Task Id For It, So I Could Use It Later As

Answered

Hey, I was planning to save the best trained model and get a Task ID for it, so I could use it later as Clearml Task.
` from clearml import Dataset, Task

task = Task.init(project_name='Machine Learning/icon-detector/training',
task_name='icon-detector_training',
task_type=Task.TaskTypes.training,
output_uri=True)
task.execute_remotely()
//// training
//// get the best model
torch.save(model.state_dict(),"best_state_dict.pth")
torch.save(model, "best_mode.pt")
task.upload_artifact('trained_model', 'model_folder/model') I don't know, but in the artifacts ` tab, and there is nothing there!!

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					DeliciousSeal67
				
					0
					 × 1

Votes Newest

Answers 6

👍

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					DeliciousSeal67
				
					0
					 × 1

Thanks for your answer CostlyOstrich36 , but how exactly ?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					DeliciousSeal67
				
					0
					 × 1

Also, this might be a little stupid sorry, but your torch save command saves the model in the current folder, whereas you give clearml the 'model_folder/model' path instead. Could it be that the path is just incorrect?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					ExasperatedCrab78
				
					0
					 × 1

thanks!

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					DeliciousSeal67
				
					0
					 × 1

Hi 🙂

Please try specifying the file itself explicitly

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

DeliciousSeal67 , something along these lines:
task.upload_artifact('<ARTIFACT_NAME>', artifact_object=os.path.join('<FOLDER>', '<FILE_NAME>'))
So in your case it would be along the lines of
task.upload_artifact('trained_model', 'model_folder/best_mode.pt')

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

1K Views

6 Answers

2 years ago

one year ago