Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hi! Is There A Way To Get The Best Model Among The Models Stored In Clearml? For Example, I Would Like To Make An Inference Using A Model Whose Acuity Is The Best In Clearml I Tried

Is there a way to get the best model among the models stored in ClearML?
For example, I would like to make an inference using a model whose acuity is the best in clearml
I tried https://clear.ml/docs/latest/docs/references/sdk/model_model#modelquery_models () but I didn't get a satisfactory result.
If possible, I don't want you to go through the Web UI.

Posted 2 years ago
Votes Newest

Answers 3

When you have experiments, you can access the reported metrics per experiment - that should allow you to decide which experiment is the best, and than you can take that experiment's model, WDYT?

Posted 2 years ago

maybe select by reported scalar value.

Here's my scenario.

  1. Proceed the experiment on a scheduled/manual basis.
  2. The results of the experiment (metric like accuracy) and model are accumulated in ClearML.
  3. Inferring the results of the experiment using the best (e.g., highest accuracy or lowest loss) model.

I would like to bring the most accurate model of ClearML stacked models using Python sdk for inferring.

Posted 2 years ago

Hi RotundPanda18 , how would you choose which is the best model?

Posted 2 years ago
3 Answers
2 years ago
one year ago