Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Does Clearml Have An Integrated Approach To Querying Model Metrics? The Objective Is To Log All Model Run Outputs In Order To Be Able To Query Them For Deployment At A Later Stage. As It Stands, I Am Currently Developing My Own Package To Log The Metrics

Does clearML have an integrated approach to querying model metrics? The objective is to log all model run outputs in order to be able to query them for deployment at a later stage. As it stands, I am currently developing my own package to log the metrics of interest & to deposit them on the cloud.

  
  
Posted 3 years ago
Votes Newest

Answers 3


Well TenseOstrich47 you can certainly add any metadata to the model itself at training time (or as a post-training job if the model is not published). I'm actually doing a couple of videos on this on the ClearSHOW, tomorrow's episode should explain this approach and there will be examples next week. DM me here if you want to know more.
https://www.youtube.com/watch?v=r2BMMDzfyA0&list=PLMdIlCuMqSTkXBApOMqg2S5IeVfnkq2Mj

  
  
Posted 3 years ago

Hi TenseOstrich47 ,

If you want to get all the scalars. you can use task.get_last_scalar_metrics() , can this help?

  
  
Posted 3 years ago

I think there is more complexity to what I am trying to achieve, but this will be a good start. Thanks!

I will need to log data set ID, transformer (not the NN architecture, just a data transformer), the model (with all hyperparameters & metadata) etc. and how all things link

  
  
Posted 3 years ago
937 Views
3 Answers
3 years ago
one year ago
Tags