Thanks a lot! I do not have problem executing the pipeline remotely, I have problam executing it locally.
Hi @<1702492411105644544:profile|YummyGrasshopper29> ! To enable caching while using a repo
, you also need to specify a commit
(as the repo might change which would invalidate the caching). We will add a warning regarding this in the near future.
Regarding the imports: we are aware that there are some problems when executing the pipeline remotely as described. At the moment, appending to sys.path is one of the only solutions (other than making utils a package on your local machine so it can be imported from anywhere). We will look into this as well asap
@<1702492411105644544:profile|YummyGrasshopper29> you could try adding the directory you are starting the pipeline with to the python path. then you would run the pipeline like this:
PYTHONPATH="${PYTHONPATH}:/path/to/pipeline_dir" python my_pipeline.py