Hi Clearml Experts. I Have A Question About Deploying Clearml On Kubenetes. Why Kubernetes? Does Clearml Also Provide An Execution Environment On Kubernetes Like Pachyderm? Or Will It Rely On External Engines (Like Say Spark On Kubernetes) To Run The Jobs

Unanswered

Hi NonsensicalSeaanemone47
I'm assuming you mean k8s as compute cluster?
If so, then yes clearml adds priority scheduling on top of your existing kl8s cluster. It also allows you to reuse images as the k8s spins the base container image and then inside the container image the agent sets the environment of the experiment (clones code, apply diff, install missing python packages etc.)
It also gives visibility into the executed pods.
Make sense ?

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

195 Views

0 Answers

3 years ago

one year ago