Hi JuicyFox94 ,
Can you try with task_overrides={'output_dest':"
s3://bucket/folder "}
?
This is not working and we donāt have any doc regarding a list of values we can override. How I can set it?
I agree, we should update the docs with some more information about it, and we will do š
(bonusĀ
Ā : the final goal should be to set output destination of every step in the pipeline with the value FROM the pipeline itself but I didnāt find any property in āPipelineControllerā class about thatĀ
Ā )
Not sure I got that, you want to have the value for the steps from the Controller?
The PipelineController task? If so, you can get the task ( pipeine_task = Task.get_task(task_id=your pipeline task id)
) and after pipeine_task.get_output_destination()
, can this do the trick?
output_dest works:)
About last point: I would like to retrieve the pipeline 'output_dest' and use it as a parameter in adding steps, is that possible?
uh... yes, i was focusing on pipelinecontroller but it's a task property. Ty, it worked!