Unanswered
Hi, I Try To Execute Pipeline With Pipelinecontroller And Define It Like This:
Pipe = Pipelinecontroller(
but tasks of this pipeline dont inherit docker and packages, why? I want to build or pull one docker and env for all pipeline steps only once, so ow can i do it?
you have to specify the docker image for the pipeline Tasks, by default it will not assume it is the same as the pipeline controller, basically just pass:
pipe.add_function_step(
name="load_data",
function=load_data,
function_kwargs={"config": config["data"]},
docker="MY CONTAINER HERE"
)
make sense?
32 Views
0
Answers
one month ago
one month ago