Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Although

Hi, although https://github.com/allegroai/clearml/issues/181 is resolved, clearml-agent (0.17.2) still logs tqdm iterations as different lines, is there something that has to be configured for the logger to overwrite the previous line?

  
  
Posted 2 years ago
Votes Newest

Answers 29


Does that mean that agents do not read this parameter?

  
  
Posted 2 years ago

SuccessfulKoala55 I can try to make one, let’s see 🙂

  
  
Posted 2 years ago

I'm not sure... Do you have a sample code to reproduce?

  
  
Posted 2 years ago

JitteryCoyote63 which version are you using?

  
  
Posted 2 years ago

TimelyPenguin76 clearml 0.17.5 and clearml-agent 0.17.2

  
  
Posted 2 years ago

It roughly adds a line every 5 secs and do not overwrite last line

  
  
Posted 2 years ago

👍

  
  
Posted 2 years ago

What will this parameter do?

  
  
Posted 2 years ago

Yes, I will try 🙂

  
  
Posted 2 years ago

Can you use sdk.development.worker.console_cr_flush_period ?

  
  
Posted 2 years ago

Ok, in that case it probably doesn’t work, because if the default value is 10 secs, it doesn’t match what I get in the logs of the experiment: every second the tqdm adds a new line

  
  
Posted 2 years ago

Add carriage return flush support using the sdk.development.worker.console_cr_flush_period configuration setting (GitHub trains Issue 181)

  
  
Posted 2 years ago

Well, it's probably possible to add a hack in your code that always sets this value in the internal logger class, but how many agents are you running? If it's very important, we guess we can add a Logger interface that allows setting this properly programmatically.

  
  
Posted 2 years ago

allows you to control the rate at which the carriage return is flushed

  
  
Posted 2 years ago

Can you check it with the latest? 1.0.2 ?

  
  
Posted 2 years ago

BTW - it's an SDK parameter, not an agent parameter

  
  
Posted 2 years ago

pip install clearml==1.0.2

  
  
Posted 2 years ago

For me this does not work (at least with nested tqdm bars, did not try single ones yet).

  
  
Posted 2 years ago

Nice! What is the default value?

  
  
Posted 2 years ago

ReassuredTiger98 no, this is an SDK configuration parameter which is read from your clearml.conf file

  
  
Posted 2 years ago

theoretically no

  
  
Posted 2 years ago

It's not the agents, but the SDK that runs as part of the task they execute

  
  
Posted 2 years ago

So I have to specify it on every clearml-agent in the respective clearml.conf?

  
  
Posted 2 years ago

You're right, its a relatively internal parameter, and is currently not documented in the default configuration file. Perhaps it's a good idea to add it to the formal documentation... default value is 10 :
` # Carriage return (\r) support. If zero (0) \r treated as \n and flushed to backend

Carriage return flush support in seconds, flush consecutive line feeds (\r) every X (default: 10) seconds

console_cr_flush_period: 10 `

  
  
Posted 2 years ago

SuccessfulKoala55 Am I doing/saying something wrong regarding the problem of flushing every 5 secs (See my previous message)

  
  
Posted 2 years ago

Ok. I just wanted to make sure I have configured my agent properly. Just want to make sure I have to set it on all agents.

  
  
Posted 2 years ago

When you say it is an SDK parameter this means that I only have to specify it on the computer where I start the task from, right? So an clearml-agent would read this parameter from the task itself.

  
  
Posted 2 years ago

so the task they execute must have clearml installed?

  
  
Posted 2 years ago

btw SuccessfulKoala55 the parameter is not documented in https://allegro.ai/clearml/docs/docs/references/clearml_ref.html#sdk-development-worker

  
  
Posted 2 years ago
521 Views
29 Answers
2 years ago
one year ago
Tags