Hello everyone. I was following the docs about creating pipelines using decorators (as it looked really neat). Everything worked well for my example, but I'v...
2 years ago
VividSparrow43
1
Question,
2
Answers
Active since 10 January 2023
Last activity
one year ago
Reputation
0
Badges 1
2 × Eureka!
0
Hello Everyone.
I Was Following The Docs About Creating Pipelines Using Decorators (As It Looked Really Neat).
Everything Worked Well For My Example, But I'Ve Noticed That Much Time For Building The Container Was Taken By Installing Packages That Weren'
So the idea of using different set of packages for pipelines in clearml is to have many different requirements.txt files?
2 years ago
0
Hello Everyone.
I Was Following The Docs About Creating Pipelines Using Decorators (As It Looked Really Neat).
Everything Worked Well For My Example, But I'Ve Noticed That Much Time For Building The Container Was Taken By Installing Packages That Weren'
I'm just thinking If I have multiple pipelines with different purposes controllers don't have the same package requirements (some of them may take a lot of time) therefore you would need multiple files for each one. Maybe the idea of having multiple pipelines for one project is wrong - I don't actually know 🤔
I was also curious if I've missed an easy way to mention required packages for the controller, like you can do that in components (by providing packages=[...] ).
2 years ago