Let me know if it solved it, if it did I'll make sure we push the RC
I think I found something relating to the issue on the subprocess not logging. Let me check if we can share something quickly
now it has log, but only the initial one
So the subprocesses are not logged ?
and one experiment takes 40 hours to run, so i let them run in parallel
Hi @<1523710701275713536:profile|PompousHawk82> , can you try with the latest RC?
Wouldn't it make sense to use a single one ?
in my case, we need to evaluate the result across many random seeds, so each task needs to log the result independently.
when i run the code i send you the other day, logging is perfect, but at the end of the code there is a semaphore warning, not sure if it’s related
check on the iteration on the right side,
i tried to start the experiment few times, and sometimes, 1 or 2 of the experiment seems just won’t start
one quick question is that do i need to do some task.close() at the end of each process?
btw, i’m running the code with multiprocessing, so the log is duplicated 3 times
Not sure on the cause but if you do:
mp.set_start_method('fork', force=True)
There is no semaphore leakage
So what if i want three tasks running in parallel, should i Task.init in the main process and change the task name in the sub process?





