I just have some for loop in some pipeline components, when processing some files. I know it increases the flush intervals and it’s working when run locally, I only see a new line from tqdm every ~30s. It’s just when I run the same script in docker using the agent I get a new line every ~5s
@<1570220858075516928:profile|SlipperySheep79> this setting does not reduce the number of lines but controls how often the console log is flushed - it basically just reduces the amount of API calls used when running an experiment that produces lots of console output
Hi @<1570220858075516928:profile|SlipperySheep79> , you need to apply the same setting on the machine that is running the agent. clearml.conf files are local and apply the settings only on the machine they're sitting on. In the Scale/Enterprise licenses there are configuration vaults that take care of this.
Hi, yes I’m using the same clearml.conf on the agent, in the logs I can see that console_cr_flush_period is set to 30