Hi @<1610083503607648256:profile|DiminutiveToad80> , can you please elaborate on what you mean/want to do?
So I am running a pipeline(using tasks) remotely and one of my task is importing stuff from one of my local repository, but it's giving me an error when I run the pipeline remotely
I am able to run the pipeline locally though
And also I have a requirements file which I want to be installed when I run the pipeline remotely
@<1610083503607648256:profile|DiminutiveToad80> , can you give a stand alone code example for such a pipeline that reproduces the issue? Each task should have it's own requirements logged. What is failing, the controller or individual steps?
@<1610083503607648256:profile|DiminutiveToad80> is this local repository where the pipeline code resides?
So what I want to do is import the custom packages into my remote execution
All I need to do is
pip install -r requirements.txt
pip install .
I am able to get the requirements installed for each task
I want to know how to execute pip install . to import all the custom packages
Custom packages which are just local to the repository cannot be installed, since the location of the cloned repository is not predefined