YEY

now it has log, but only the initial one

Let me check that for a sec

Thanks!

btw, i’m running the code with multiprocessing, so the log is duplicated 3 times

Let me know if it solved it, if it did I'll make sure we push the RC

Hi @<1523710701275713536:profile|PompousHawk82> , can you try with the latest RC?

Can I send you a wheel to test ?

Releasing an RC

not sure if it’s the problem with map

I think I found something relating to the issue on the subprocess not logging. Let me check if we can share something quickly

yes, that’s the error i got

pip install clearml==1.0.3rc1

works most of time, this occurs only few times

Hmm so the Task.init should be called on the main process, this way the subprocess knows the Task is already created (you can call Task.init twice to get the task object). I wonder if we somehow can communicate between the sub processes without initializing in the main one...

You can use this to reproduce

when i run the code i send you the other day, logging is perfect, but at the end of the code there is a semaphore warning, not sure if it’s related

🤞

No need, it should auto close it if you started it with Task.init (or the agent executed it)

Why are you initializing 3 diff Tasks ?

in my case, we need to evaluate the result across many random seeds, so each task needs to log the result independently.

one quick question is that do i need to do some task.close() at the end of each process?

working very well actually

there is a semaphore warning, not sure if it’s related

Can you resend it?
Is the Task marked as closed when the process ends ?

Actually, before i update the clearml pkg, the 0.17 version can log the console even i init it in the subprocess, but the problem is that it will only won log all 3 subprocesses

Let me know if you need some tests

Not sure on the cause but if you do:

mp.set_start_method('fork', force=True)

There is no semaphore leakage