Unanswered
Clearml Pipelines Can Be Build From Tasks, Functions, And Decorated Functions, According To The Examples In
I'm not sure how the decorators achieve that; from the available examples and trials I've done, it seems that:
- Components anyway need to be available when you define the pipeline controller/decorator, i.e. same codebase
- The component code still needs to be self-composed (or, function component can also be quite complex)
- Decorators do not allow any dynamic build, because you must know how the component are connected at decoration time
With that said, it could be that the provided examples are overly simplistic. At the moment I do not see how one cancheck results before deciding to continue, ... have adjustable loops and parallelization depending on arguments
, at least the latter half is more easily doable with the non-decorator approach.
Can you provide a more realistic code example @<1523701205467926528:profile|AgitatedDove14> ? I'd love to simplify and extend our usage of pipelines, but I haven't seen this functionality at all.
172 Views
0
Answers
one year ago
one year ago