when i run the code i send you the other day, logging is perfect, but at the end of the code there is a semaphore warning, not sure if it’s related

No need, it should auto close it if you started it with Task.init (or the agent executed it)

one quick question is that do i need to do some task.close() at the end of each process?

there is a semaphore warning, not sure if it’s related

Can you resend it?
Is the Task marked as closed when the process ends ?

And only the main one ?

Wouldn't it make sense to use a single one ?

How do I reproduce it ? (all the processes are on the same machine?)

No sure, here is the code

Nice job

we need to evaluate the result across many random seeds, so each task needs to log the result independently.

Ohh that kind of makes sense to me 🙂
Yes I'm also getting:

/usr/local/lib/python3.6/multiprocessing/semaphore_tracker.py:143: UserWarning: semaphore_tracker: There appear to be 74 leaked semaphores to clean up at shutdown
  len(cache))

Not sure about that ...

Hmm let me check something

and one experiment takes 40 hours to run, so i let them run in parallel

i can only see the init log

No sure what O'm seeing here

now it has log, but only the initial one

So the subprocesses are not logged ?

yeah sure