If you one each "main" process as a single experiment, just don't call Task.init in the scheduler

See on line 212 I am calling one function "combined" with some arguments

Hi @<1523701205467926528:profile|AgitatedDove14> , I wanted to ask you something. Is it possible that we can talk over voice somewhere so that I can explain my problem better?

but what is happening is it is creating new task under same project with same task name

Sure @<1523720500038078464:profile|MotionlessSeagull22> DM me 🙂

I didn't got it.

Create one experiment (I guess in the scheduler)
task = Task.init('test', 'one big experiment')
Then make sure the the scheduler creates the "main" process as subprocess, basically the default behavior)
Then the sub process can call Task.init and it will get the scheduler Task (i.e. it will not create a new task). Just make sure they all call Task init with the same task name and the same project name.

no i want all of them in the same experiment

and it should log it into the same task and same project

Sure

Just call the Task.init before you create the subprocess, that's it 🙂 they will all automatically log to the same Task. You can also call the Task.init again from within the subprocess task, it will not create a new experiment but use the main process experiment.

@<1523701205467926528:profile|AgitatedDove14> I want to log directly to trains using logger.report_scalar

Are you using tensorboard or do you want to log directly to trains ?

Like here in the sidebar I am getting three different plots named as loss, train_loss and test_loss

So you want these two on two different graphs ?

so, like if validation loss appears then there will be three sub-tags under one main tag loss

What do you mean by "tag" / "sub-tags"?

and under that there will be three graphs with title as train test and loss

its like main title will be loss

so, if I call Task.init() before that line there is no need of calling Task.init() on line number 92

I have to create a main task for example named as main

Oh I got it.

like in the sidebar there should be a title called "loss" and under that two different plots should be there named as "train_loss" and "test_loss"

but this gives the results in the same graph

In the side bar you get the title of the graphs, then when you click on them you can see the diff series on the graphs themselves

so I want loss should be my main title and I want two different graphs of train and test loss under that loss

You can always click on the name of the series and remove it for display.
Why would you need three graphs?

"validate

It will not create another 100 tasks, they will all use the main Task. Think of it as they "inherit" it from the main process. If the main process never created a task (i.e. no call to Tasl.init) then they will create their own tasks (i.e. each one will create its own task and you will end up with 100 tasks)

then if there are 100 experiments how it will create 100 tasks?