Hi, Thanks For Making This Awesome Mlops Solution! I'M Trying To Get Gcp Autoscaler To Work In Docker Mode But The Vm Instances Keep Crashing After Running The Agent. Pretty Sure The Service Account Grants Sufficient Permissions To Do Whatever Needed. An

Answered

Hi, thanks for making this awesome MLOps solution!

I'm trying to get GCP Autoscaler to work in docker mode but the vm instances keep crashing after running the agent. Pretty sure the service account grants sufficient permissions to do whatever needed.
Anyone knows the cause of this?

Please check the attached logs and configurations.
Thank you in advance!

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Votes Newest

Answers 6

Hi @<1578193384537853952:profile|MoodyOx45> , can you verify that docker is installed on the machine image you're trying to use? The agent uses that, and I assume it will simply exit if it's not there...

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I don't think docker is there since the machine image field in the autoscaler config is limited to the public ones.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Will adding some init script to install docker do the trick?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Yes, it would - the init script is run before the agent is started

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

(sorry for the late reply, somehow I missed you comments 😞 )

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

nvm, it's working somehow 🎉 . thanks a lot!

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Write your answer

1K Views

6 Answers

one year ago