Hi, Thanks For Making This Awesome Mlops Solution! I'M Trying To Get Gcp Autoscaler To Work In Docker Mode But The Vm Instances Keep Crashing After Running The Agent. Pretty Sure The Service Account Grants Sufficient Permissions To Do Whatever Needed. An

Answered

Hi, thanks for making this awesome MLOps solution!

I'm trying to get GCP Autoscaler to work in docker mode but the vm instances keep crashing after running the agent. Pretty sure the service account grants sufficient permissions to do whatever needed.
Anyone knows the cause of this?

Please check the attached logs and configurations.
Thank you in advance!

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Votes Newest

Answers 6

Hi @<1578193384537853952:profile|MoodyOx45> , can you verify that docker is installed on the machine image you're trying to use? The agent uses that, and I assume it will simply exit if it's not there...

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I don't think docker is there since the machine image field in the autoscaler config is limited to the public ones.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

(sorry for the late reply, somehow I missed you comments 😞 )

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Yes, it would - the init script is run before the agent is started

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Will adding some init script to install docker do the trick?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

nvm, it's working somehow 🎉 . thanks a lot!

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Write your answer

2K Views

6 Answers

2 years ago