Another Qn, Currently When Building Pipelines. We Use Python Codes As Steps. Is It Possible To Substitute These Steps Using Containers Instead. The Main Reason, Being This Will Be Much More Faster Than In Each Step Vs (Building Docker Image And Running Co

Unanswered

Hi, using the pipeline examples, with
step1_dataset_artifact.py, step2_data_processing.py, step3_train_model.py ==> pipeline_controller.pyIn the above example, the pipeline_controller is stringing together 3 python files, instead could it string together 3 containers instead. Of course, we can manually compile each into a docker image, but does clearml has some similar approach baked in.

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					DeliciousBluewhale87
				
					0
					 × 1

162 Views

0 Answers

3 years ago

one year ago