Hi, Thanks For Making This Awesome Mlops Solution! I'M Trying To Get Gcp Autoscaler To Work In Docker Mode But The Vm Instances Keep Crashing After Running The Agent. Pretty Sure The Service Account Grants Sufficient Permissions To Do Whatever Needed. An

Answered

Hi, thanks for making this awesome MLOps solution!

I'm trying to get GCP Autoscaler to work in docker mode but the vm instances keep crashing after running the agent. Pretty sure the service account grants sufficient permissions to do whatever needed.
Anyone knows the cause of this?

Please check the attached logs and configurations.
Thank you in advance!

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Votes Newest

Answers 6

Hi @<1578193384537853952:profile|MoodyOx45> , can you verify that docker is installed on the machine image you're trying to use? The agent uses that, and I assume it will simply exit if it's not there...

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Will adding some init script to install docker do the trick?

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Yes, it would - the init script is run before the agent is started

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

(sorry for the late reply, somehow I missed you comments 😞 )

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I don't think docker is there since the machine image field in the autoscaler config is limited to the public ones.

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

nvm, it's working somehow 🎉 . thanks a lot!

  				
Posted 
	5 months ago

					More
				  		
  Report
		
					MoodyOx45
				
					0
					 × 1

Write your answer

325 Views

6 Answers

5 months ago