I have an interesting issue. It seems like when I run several agents on the same server I run into an issue where some of the agents will timeout when connecting to github. Each task in the pipeline is pulling from the same repo and it's working for some of the tasks and not for others. I was thinking that it could be a rate limit issue (but I'm not sure). I'm going to reduce the number of agents to see if that helps but I'm curious if it's possible to "retry" in the case of an ssh timeout? Maybe some fix number of times before killing the process. It's a shame that an entire dag will fail because one or two instances. Any suggestions are welcome as well.

logs:

2024-01-24 16:21:36
Could not lock cache folder "LTV.git" (timeout 300 sec), using temp vcs cache.
cloning: git@github.com:TicketSwap/LTV.git
2024-01-24 16:23:50
ssh: connect to host github.com port 22: Connection timed out
fatal: Could not read from remote repository.