Oh, that may work. Is there any docs/demos on this?
That's a good question, which I don't have an answer to 😅 I was hoping to be able to store the config file in some kind of secrets vault, and authenticating via some in-memory trace or so
Hi TenseOstrich47 , where would you consider it a good place to tore your credentials?
Well, if you have a way of retrieving values before a task is executed, the credentials can be passed using environment variables
I don't even know if I have a valid concern for this. Just a little worried as airflow is accessible by more departments than just DS, which could result in some disasters