It's too much of a hack :)

The agent is started with this command:
clearml-agent --debug daemon --queue gpu --gpus 0 --foreground --docker <gitlab org registry>/project-precog/clearml_config

The agent is started from a non-root user if that matters

Sure, will send in a few min when it executes

Thanks!

Ok, it makes sense. But it’s running in docker mode and it is trying to ssh into the host machine and failing

I also use TB.

I solved the issue by implementing my own ClearML logger

The issue disappeared after I switched from docker mode to pip mode

AgitatedDove14
made a new one:
https://pastebin.com/LxLFk7py

I mean if I enter my host machine ssh password it works. But we will disable password auth in future, so it’s not an option

Is there a way to check if the port is accessible from my local machine?

All ports are open (both agent machine and client machine are working within same VPN)

I start clearml-session on my mac this way:
clearml-session --queue gpu --docker registry.gitlab.com/periplo-innovation/project-precog/clearml_config

The task log is here:
the log on my local machine is here:

But what should I do? It does not work, it says incorrect password as you can see

I can telnet the port from my mac:
(base) *[main][~/Documents/plant_age]$ telnet 192.168.1.55 10022 Trying 192.168.1.55... Connected to 192.168.1.55. Escape character is '^]'. SSH-2.0-OpenSSH_8.4p1 Debian-5+deb11u1 ^C

Btw it seems the docker runs in network=host