Hey There! I Was Wondering If There Is Any Existing Support For Integration Between A Self-Hosted Clearml Server And A Slurm Cluster. I Can Certainly Queue Up A Slurm Job For Any Given Task, But Is There An Easy Way To Do This Automatically Whenever A Tas

Answered

Hey there! I was wondering if there is any existing support for integration between a self-hosted ClearML server and a SLURM cluster. I can certainly queue up a SLURM job for any given task, but is there an easy way to do this automatically whenever a task gets enqueued?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MammothPigeon75
				
					0

Votes Newest

Answers 2

Hi John @<1569133676640342016:profile|MammothPigeon75> ! How you queue up a slurm jobs for task with distributed calculations (like Pytorch Lightning)?

Please give me some help

Thank you in advance!

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SweetShells3
				
					0
					 × 1

Hi @<1569133676640342016:profile|MammothPigeon75> , I believe such SLURM integration of what you described is supported on ClearML Scale/Enterprise versions

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

1K Views

2 Answers

one year ago