Let me check, see what can be learned ...
Not sure on the cause but if you do:
mp.set_start_method('fork', force=True)
There is no semaphore leakage
and one experiment takes 40 hours to run, so i let them run in parallel
in my case, we need to evaluate the result across many random seeds, so each task needs to log the result independently.
I think I found something relating to the issue on the subprocess not logging. Let me check if we can share something quickly
How do I reproduce it ? (all the processes are on the same machine?)
when i run the code i send you the other day, logging is perfect, but at the end of the code there is a semaphore warning, not sure if it’s related