Hi! Is There A Way To Get The Best Model Among The Models Stored In Clearml? For Example, I Would Like To Make An Inference Using A Model Whose Acuity Is The Best In Clearml I Tried

Answered

Hi!
Is there a way to get the best model among the models stored in ClearML?
For example, I would like to make an inference using a model whose acuity is the best in clearml
I tried https://clear.ml/docs/latest/docs/references/sdk/model_model#modelquery_models () but I didn't get a satisfactory result.
If possible, I don't want you to go through the Web UI.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					RotundPanda18
				
					0
					 × 1

Votes Newest

Answers 3

When you have experiments, you can access the reported metrics per experiment - that should allow you to decide which experiment is the best, and than you can take that experiment's model, WDYT?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Hi RotundPanda18 , how would you choose which is the best model?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

maybe select by reported scalar value.

Here's my scenario.

Proceed the experiment on a scheduled/manual basis.
The results of the experiment (metric like accuracy) and model are accumulated in ClearML.
Inferring the results of the experiment using the best (e.g., highest accuracy or lowest loss) model.

I would like to bring the most accurate model of ClearML stacked models using Python sdk for inferring.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					RotundPanda18
				
					0
					 × 1

Write your answer

1K Views

3 Answers

2 years ago

one year ago