Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, My Dl Workflow Includes Post-Training Quantization. Is There A Way To Implement These Procedures In Clearml?

Hello,
My DL workflow includes post-training quantization. Is there a way to implement these procedures in ClearML?

  
  
Posted 2 years ago
Votes Newest

Answers 6


MistakenBee55 how about a Task doing the Model quantization, then trigger it with TriggerScheduler ?
https://github.com/allegroai/clearml/blob/master/examples/scheduler/trigger_example.py

  
  
Posted 2 years ago

However, SNPE performs quantization with precompiled CLI binary instead of python library (which also needs to be installed). What would be the pipeline in this case?

I would imagine a container with preinstalled SNPE compiler / quantizer, and a python script triggering the process ?

one more question: in case of triggering the quantization process, will it be considered as separate task?

I think this makes sense, since you probably want a container with the SNE environment, meaning you cannot use a simple trigger function. wdyt?

  
  
Posted 2 years ago

AgitatedDove14 , one more question: in case of triggering the quantization process, will it be considered as separate task? I mean, will I be able to clone it and rerun with different parameters (bitness, optimizations, etc) for the same trained network?

  
  
Posted 2 years ago

Can you please give an example?

  
  
Posted 2 years ago

CostlyOstrich36 Typical workflow is the following:
Train object detection CNN Pick the best checkpoint Perform https://www.tensorflow.org/lite/performance/post_training_quantization in tflite, OpenVino or SNPE to obtain quantized model. It requires a set of representative image files.What I'd like to do is to run quantization procedure for various frameworks (listed above) for a given task on its' completion

  
  
Posted 2 years ago

AgitatedDove14 Thanks for advise, I think it would work for tflite. However, SNPE performs quantization with precompiled CLI binary instead of python library (which also needs to be installed). What would be the pipeline in this case?

  
  
Posted 2 years ago
864 Views
6 Answers
2 years ago
one year ago
Tags