Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
With Clearml 1.0 It Seems That Console Logs Are Only Shown In The Web Ui When The Task Has Finished. Is This Expected Behaviour? With Previous Versions I Was Able To See "Live" Output. I Tested This With The Pytorch_Tensorboardx.Py Example. I Run The Scri

With clearml 1.0 it seems that console logs are only shown in the web ui when the task has finished. Is this expected behaviour? With previous versions I was able to see "live" output.
I tested this with the pytorch_tensorboardX.py example.
I run the script locally and track it with clearml. With remote_execution this problem seems not to exists.

  
  
Posted 3 years ago
Votes Newest

Answers 21


Guys, any chance you can verify the RC solves the issue?
pip install clearml==1.0.2rc0

  
  
Posted 3 years ago

Thanks for the information. do you get any errors? Warnings?

  
  
Posted 3 years ago

Hi ReassuredTiger98 , can you share your clearml version?

  
  
Posted 3 years ago

give me a sec

  
  
Posted 3 years ago

No errors, no warnings.

  
  
Posted 3 years ago

DilapidatedDucks58 also with 1.0.1 version?

  
  
Posted 3 years ago

Okay, releasing a fix

  
  
Posted 3 years ago

Awesome ! thank you so much!
1.0.2 will be out in an hour

  
  
Posted 3 years ago

So clearml 1.0.1 clearml-agent 1.0.0 and clearml-server from master

  
  
Posted 3 years ago

YEY

  
  
Posted 3 years ago

I colleague fixed my server and I can confirm, that the fix works!

  
  
Posted 3 years ago

When the task is aborted I, the logs will show up, but the scalar logs will never appear. The scalar logs only appear when the task finishes.

  
  
Posted 3 years ago

latest for everything.

  
  
Posted 3 years ago

My clearml-server server crashed for some reason, so I won't be able to verify until tomorrow.

  
  
Posted 3 years ago

yeah, server (1.0.0) and client (1.0.1)

  
  
Posted 3 years ago

My clearml-server server crashed for some reason

😞 No worries

  
  
Posted 3 years ago

👍 let me check that

  
  
Posted 3 years ago

I just tested with remote_execution and the problem seems to exist there, too. It is just that when the task switches from local to remote execution (i.e. exists the local script) the local scalars will appear, but no scalar of remote execution will show up. So also the iteration will not update. However, at least for remote execution I get live console output.

  
  
Posted 3 years ago

quick update 1.0.2 will be ready in an hour, apologies 😞

  
  
Posted 3 years ago

same here, no live logs

  
  
Posted 3 years ago

yeap, it works 😍

  
  
Posted 3 years ago