Unanswered
How Can I Send A Composed Chunk Of Code For Remote Execution
Then I wonder:
- How to achieve this? The pipeline controller seems to only work with functions, not classes, so running smaller steps remotely seems more difficult then I imagined. I was already prepared to upload artifacts myself etc, but now I’m not sure?
- Do I really need to recreate the pipeline everytime from scratch? Or can I remove/edit steps? It’s mostly used as a… controller for notebook-based executions and experimentations, before the actual pipeline is known. That is, it will allow experimenting with building the desired pipeline and its steps. Ideally all these
Step
classes would result in aTask
which is much easier to handle and/or navigate.
114 Views
0
Answers
11 months ago
11 months ago