My Autoscaled Instance Fails When Running "Git Clone" On A Private Repo. I

Answered

My autoscaled instance fails when running "git clone" on a private repo.

I do have the SSH key placed at /root/.ssh/id_rsa on the machine, and when I SSH into the machine and run sudo su; git clone <the repo> it succeeds.

Also, in the extra_vm_bash_script field: I added a whoami command which prints root , so it seems like the user being used to run the git clone during task execution is in fact root .

For context, here's the startup command that the autoscaler runs:

python -m clearml_agent --config-file /root/clearml.conf daemon --queue aws_4gpu_machines --docker python:3.9

Full log included...

  				
Posted 
	one year ago

					More  		
  Report
		
					BattyCrocodile47
				
					0
					 × 1

Votes Newest

Answers 34

I do agree with your earlier observation that the target of that mount seems wrong. I would think that the volume mount should be -v /root/.ssh:/root/.ssh but instead it's -v /root.ssh:/.ssh

  				
Posted 
	one year ago

					More  		
  Report
		
					BattyCrocodile47
				
					0
					 × 1

Hi BattyCrocodile47

I

do

have the SSH key placed at

/root/.ssh/id_rsa

on the machine,

Notice that the .ssh folder is mounted from the host (EC2 / GCP) into the container,

'-v', '/tmp/clearml_agent.ssh.cbvchse1:/.ssh'

This is odd, why is it mounting it to /.ssh and not /root/.ssh ?

  				
Posted 
	one year ago

					More  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Here's a screenshot if a session where I first try to clone as ssm-user , but it fails, then I change to root and it succeeds

  				
Posted 
	one year ago

					More  		
  Report
		
					BattyCrocodile47
				
					0
					 × 1

I'm not seeing a extra_docker_shell_script in my clearml.conf generated by clearml-agent init like in this guide

  				
Posted 
	one year ago

					More  		
  Report
		
					BattyCrocodile47
				
					0
					 × 1

Show more results

Write your answer

121K Views

34 Answers

one year ago