It still didn't work. I created the ssh keys on the agent with ssh-keygen -C "<user>" , added the public key to bitbucket to allow it, and didn't specified the SSH_AUTH_SOCK now. Am I missing something? Do I need to setup an ssh-agent on host before spinning up the agent?