Hmm let me check something

now it has log, but only the initial one

i can only see the init log

works most of time, this occurs only few times

Nice job

No sure what O'm seeing here

Let me check, see what can be learned ...

Hmm so the Task.init should be called on the main process, this way the subprocess knows the Task is already created (you can call Task.init twice to get the task object). I wonder if we somehow can communicate between the sub processes without initializing in the main one...

Releasing an RC

I think I found something relating to the issue on the subprocess not logging. Let me check if we can share something quickly

we need to evaluate the result across many random seeds, so each task needs to log the result independently.

Ohh that kind of makes sense to me 🙂
Yes I'm also getting:

/usr/local/lib/python3.6/multiprocessing/semaphore_tracker.py:143: UserWarning: semaphore_tracker: There appear to be 74 leaked semaphores to clean up at shutdown
  len(cache))

Not sure about that ...

You can use this to reproduce

and one experiment takes 40 hours to run, so i let them run in parallel

No need, it should auto close it if you started it with Task.init (or the agent executed it)

How do I reproduce it ? (all the processes are on the same machine?)

Hi @<1523710701275713536:profile|PompousHawk82> , can you try with the latest RC?

one quick question is that do i need to do some task.close() at the end of each process?

Wouldn't it make sense to use a single one ?

YEY

Let me check that for a sec

not sure if it’s the problem with map

Why are you initializing 3 diff Tasks ?

now it has log, but only the initial one

So the subprocesses are not logged ?

working very well actually

seems the not logging problem is back

And only the main one ?

btw, i’m running the code with multiprocessing, so the log is duplicated 3 times