Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey All. I Am Looking To Integrate Clearml Into Airflow. I Want To Use Airflow To Orchestrate Running Clearml Pipelines. My Question Is About Authentication From Airflow; I Have A Config File On My Local Which Authenticates Me To Send Tasks Over To Clearm

Hey all. I am looking to integrate ClearML into Airflow. I want to use Airflow to orchestrate running ClearML pipelines. My question is about authentication from Airflow; I have a config file on my local which authenticates me to send tasks over to ClearML. How would this work for Airflow? I am skeptical of storing a credentials file on the airflow server. Any insight is appreciated

  
  
Posted 3 years ago
Votes Newest

Answers 6


Hi TenseOstrich47 , where would you consider it a good place to tore your credentials?

  
  
Posted 3 years ago

That's a good question, which I don't have an answer to 😅 I was hoping to be able to store the config file in some kind of secrets vault, and authenticating via some in-memory trace or so

  
  
Posted 3 years ago

I don't even know if I have a valid concern for this. Just a little worried as airflow is accessible by more departments than just DS, which could result in some disasters

  
  
Posted 3 years ago

Well, if you have a way of retrieving values before a task is executed, the credentials can be passed using environment variables

  
  
Posted 3 years ago

Oh, that may work. Is there any docs/demos on this?

  
  
Posted 3 years ago
927 Views
6 Answers
3 years ago
one year ago
Tags