Hi ReassuredTiger98 , can you share your clearml
version?
So clearml 1.0.1 clearml-agent 1.0.0 and clearml-server from master
When the task is aborted I, the logs will show up, but the scalar logs will never appear. The scalar logs only appear when the task finishes.
My clearml-server server crashed for some reason, so I won't be able to verify until tomorrow.
Guys, any chance you can verify the RC solves the issue?pip install clearml==1.0.2rc0
DilapidatedDucks58 also with 1.0.1 version?
My clearml-server server crashed for some reason
😞 No worries
Awesome ! thank you so much!
1.0.2 will be out in an hour
yeah, server (1.0.0) and client (1.0.1)
Thanks for the information. do you get any errors? Warnings?
I just tested with remote_execution and the problem seems to exist there, too. It is just that when the task switches from local to remote execution (i.e. exists the local script) the local scalars will appear, but no scalar of remote execution will show up. So also the iteration will not update. However, at least for remote execution I get live console output.
quick update 1.0.2 will be ready in an hour, apologies 😞
I colleague fixed my server and I can confirm, that the fix works!