Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Has Anybody Integrated Airflow With Clearml Here? If So, What Has Been Your Experience?

Has anybody integrated Airflow with ClearML here? If so, what has been your experience?

  
  
Posted 3 years ago
Votes Newest

Answers 2


We are planning to use Airflow as an extension of clearml itself, for several tasks:
we want to isolate the data validation steps from the general training pipeline; the validation will be handled using some base logic and some more advanced validations using something like great expectations. our training data will be a snapshot from the most recent 2 weeks, and this training data will be used across multiple tasks to automate the scheduling and execution of training pipelines periodically executing the ETL pipelines for writing training logs to a more query-friendly DWH using the DWH to automate the decision making on which model to deploy to production post-live deployment: airflow will run the ETL for the feedback data we collect. this ETL includes a validation step to measure data drift, model performance once live etc

  
  
Posted 3 years ago

Sadly, I haven't, but if anyone has then please scream because I would love to pick your brain for (yet another) post/article I am writing 😄 😄

I take it you are wanting to use Airflow to replace/extend an existing Jenkins setup ??

  
  
Posted 3 years ago
993 Views
2 Answers
3 years ago
one year ago
Tags