Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! I Am Setting Up My First Clearml Agent (Ec2) Connecting To My Hosted Clearmlserver. I Am At The Step Where I Am Granting The Agent Access To Github. I Am Using Ssh Authentication, So I:

Hi! I am setting up my first ClearML agent (EC2) connecting to my hosted ClearMLServer.

I am at the step where I am granting the agent access to github. I am using SSH authentication, so I:

  • Generated SSH keys and added the key to the ssh agent
  • Added the generatid public key to my GitHub user
  • checked that I can do a git clone of my repo in the EC2 instance (agent) ..OK
  • update clearml.conf to set force_git_ssh_protocol: true
    Then I start the agent like this
    clearml-agent daemon --queue test-queue

Then I clone the task, enqueue it, my agent starts running it and then I get this message:

cloning: git@github.com:.../....git
git@github.com: Permission denied (publickey).
fatal: Could not read from remote repository.

I am a bit lost here because I am able to clone the repo but when running the agent I get this error.

  
  
Posted 11 months ago
Votes Newest

Answers 8


Hi @<1523701087100473344:profile|SuccessfulKoala55> it’s failing again.. I haven’t rebooted the agent or changed anything and I am able to connect with ssh with ssh -vT git@github.com on a different tmux sess.

This is the error I am seeing running the agent with the -debug flag:

Using cached repository in "/home/ubuntu/.clearml/vcs-cache/clearml-tutorial.git.e1c2351b09f3d661b6f0dbf85e92be2e/clearml-tutorial.git"
git@github.com: Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
error: Could not fetch origin
Repository cloning failed: Command '['git', 'fetch', '--all', '--recurse-submodules']' returned non-zero exit status 1.

clearml_agent: ERROR: Failed cloning repository.
  
  
Posted 11 months ago

Hei @<1523701087100473344:profile|SuccessfulKoala55> it just worked. Maybe there was some github refresh delay … not sure but thanks anyways for the debug suggestion. 👍

  
  
Posted 11 months ago

will give it a try with debug….

  
  
Posted 11 months ago

Hi @<1603198134261911552:profile|ColossalReindeer77> , you can run the agent in --debug mode to get more info

  
  
Posted 11 months ago

Hey @<1523701087100473344:profile|SuccessfulKoala55> just updating you here. I started from scratch, new EC2 instance, follow the installation step by step and the only change that I made was selecting rsa instead of ed255190 for the generation of the SSH key (as per github docs ), and now I my agent can connect consistently to GitHub. Just thought of posting this in case someone else runs into a similar issue in the future, this is what worked for me!

  
  
Posted 11 months ago

but from a terminal I can do:

ubuntu@***:~/sw/clearml-tutorial$ git fetch --all --recurse-submodules
Fetching origin

and it works

  
  
Posted 11 months ago

In general, the agent will simply use git to clone the repository, so the local system settings should apply

  
  
Posted 11 months ago

yeah that’s why it’s weird …

  
  
Posted 11 months ago
787 Views
8 Answers
11 months ago
11 months ago
Tags
Similar posts