Would the training script be able to register to the server when there is no public IP.
I guess it's more related to networking inside GCP, but just wanted to know if anyone tried it.

Hmm, as long as you can access it from within the LAN, it should work ...
Please update when you try it out 🙂