yes

If you one each "main" process as a single experiment, just don't call Task.init in the scheduler

So you want these two on two different graphs ?

then if there are 100 experiments how it will create 100 tasks?

so, if I call Task.init() before that line there is no need of calling Task.init() on line number 92

so , it will create a task when i will run it first time

okay, Thanks @<1523701205467926528:profile|AgitatedDove14> for the help.

You can do:
task = Task.get_task(task_id='uuid_of_experiment')
task.get_logger().report_scalar(...)

Now the only question is who will create the initial Task, so that the others can report to it. Do you have like a "master" process ?

then if there are 10 experiments then I have to call Task.create() for those 10 experiments

so, like if validation loss appears then there will be three sub-tags under one main tag loss

This code gives me the graph that I displayed above

What do you mean by "tag" / "sub-tags"?

like if u see in above image my project name is abcd18 and under that there are experiments Experiment1, Experiment2 etc.

and then log using logger

logger.report_scalar("loss", "train", iteration=0, value=100)
logger.report_scalar("loss", "test", iteration=0, value=200)

each subprocess logs one experiment as task

I have one more question?

And you want all of them to log into the same experiment ? or do you want an experiment per 60sec (i.e. like the scheduler)

Just so I understand,
scheduler executes main every 60sec
main spins X sub-processes
Each subprocess needs to report scalars ?

It will not create another 100 tasks, they will all use the main Task. Think of it as they "inherit" it from the main process. If the main process never created a task (i.e. no call to Tasl.init) then they will create their own tasks (i.e. each one will create its own task and you will end up with 100 tasks)

Sure

what changes should I make here?

I have to create a main task for example named as main

and that function creates Task and log them

but this gives the results in the same graph

Create one experiment (I guess in the scheduler)
task = Task.init('test', 'one big experiment')
Then make sure the the scheduler creates the "main" process as subprocess, basically the default behavior)
Then the sub process can call Task.init and it will get the scheduler Task (i.e. it will not create a new task). Just make sure they all call Task init with the same task name and the same project name.

like in the above picture

You can always click on the name of the series and remove it for display.
Why would you need three graphs?

then my combined function create a sub task using Task.create(task_name=exp_name)