Hi everyone! I use ClearML in Airflow Task. When I'm trying to init a ClearML Task, it dies without errors in logs. The credentials are correct. Airflow works on my local machine. The code works well when I run it from the terminal but fails when I run it through Airflow DAG.
Maybe somebody knows how to fix that?
def configure_clearml(self) -> Tuple[Task, Logger]: logging.info('Initializing ClearML') clearml_config = self.vars.get_clearml() logging.info(f'ClearML config: {clearml_config}') # TODO: remove Task.set_credentials( api_host=clearml_config['api_server'], web_host=clearml_config['web_server'], files_host=clearml_config['files_host'], key=clearml_config['api_access_key'], secret=clearml_config['api_secret_key'], ) now = self.logical_date.strftime(DT_FORMAT) task = Task.init(project_name='sheldon', task_name=f'revenue {now}') clearml_logger = task.get_logger() return task, clearml_logger