Hmm, any suggestion on making it more visible or on the interface ? (I mean deleting the cache file is always a solution, but it sounded quite painful to debug, hence the question)
It cached my SSH parameters and finally after removing all of them it worked
It seems like the configuration is cached in a way even when you change the CLI parameters.
@<1523704461418041344:profile|EnormousCormorant39> nice!
Yes the configuration is cached so that after you set it once you can just call clearml-session again without all the arguments
What was the actual issue ? Should we add something to the printout?
@<1523701205467926528:profile|AgitatedDove14> @<1523701070390366208:profile|CostlyOstrich36> Thanks for the help
I finally figured out the issue.
It seems like the configuration is cached in a way even when you change the CLI parameters.
After adding explicit JSON with configuration I managed to run it
I mean SSH through the terminal works fine.
The issue is with Clearml-session.
I tried to remove the username/password and remote-host yesterday but it ended up asking me for the password when connecting and not accepting it.
2023-02-15 12:49:22,813 - clearml - WARNING - Could not retrieve remote configuration named 'SSH'
This is fine, it means it uses the default identity keys
The thing is - when I try to connect with normal SSH there are no issues
Now I'm lost, so when exactly do you see the issue ?
I see now an interesting warning
2023-02-15 12:49:22,813 - clearml - WARNING - Could not retrieve remote configuration named 'SSH'
The thing is - when I try to connect with normal SSH there are no issues
ssh user@ip
I’m trying to connect for Mac to Linux @<1523701070390366208:profile|CostlyOstrich36>
Clearml-agent is installed on another machine in the internal network @<1523701205467926528:profile|AgitatedDove14>
Yes sure - this is what I see in the logs
> Setting up openssh-sftp-server (1:8.2p1-4ubuntu0.5) ...
> Setting up python3-distro (1.4.0-1) ...
Remote machine is ready
Setting up connection to remote session
Starting SSH tunnel
Sometimes it is working fine, but sometimes I get this error message
@<1523704461418041344:profile|EnormousCormorant39> can I assume there is a gateway at --remote-gateway <internal-ip>
?
Could it be that this gateway has some network firewall blocking some of the traffic ?
If this is all local network, why do you need to pass --remote-gateway ?
Hi @<1523704461418041344:profile|EnormousCormorant39> , is there any chance this could be indeed network related if it does manage to work sometimes?
Can you add a larger portion of the log with errors?
Also what type of machines are these? Linux to linux?