when i run the code i send you the other day, logging is perfect, but at the end of the code there is a semaphore warning, not sure if it’s related

Not sure on the cause but if you do:

mp.set_start_method('fork', force=True)

There is no semaphore leakage

there is a semaphore warning, not sure if it’s related

Can you resend it?
Is the Task marked as closed when the process ends ?

Why are you initializing 3 diff Tasks ?

working very well actually

works most of time, this occurs only few times

Nice job

Let me know if you need some tests

Wouldn't it make sense to use a single one ?

Hmm let me check something

we need to evaluate the result across many random seeds, so each task needs to log the result independently.

Ohh that kind of makes sense to me 🙂
Yes I'm also getting:

/usr/local/lib/python3.6/multiprocessing/semaphore_tracker.py:143: UserWarning: semaphore_tracker: There appear to be 74 leaked semaphores to clean up at shutdown
  len(cache))

Not sure about that ...

Let me know if it solved it, if it did I'll make sure we push the RC

Actually, before i update the clearml pkg, the 0.17 version can log the console even i init it in the subprocess, but the problem is that it will only won log all 3 subprocesses

🤞

Let me check, see what can be learned ...

yeah sure