Unanswered
Question About Pipeline : My Setup Is As Follow:
the pipeline is to orchestrate tasks to create more complex functionality, and take advantage of caching, yes.
here I run backtesting (how well did i predict the future), and can control frequency "every week, every month" etc.
so if I increase frequency, I dont need to rerun certain branches of the pipeline and therefore they are cached. another example: if I change something that impacts layer 3 but not layer 1-2, then about half my tasks are cached.
the pictured pipeline is: "create data, then optionally filter it, then train/eval, then summarize average performance"
52 Views
0
Answers
4 months ago
4 months ago