You mean the job with the exact same arguments ?
do you have other arguments you are passing ?
Are you using Optuna / HBOB ?

Optuna

Only one param, just playing around

The job itself doesn’t have any other param

You mean the job with the exact same arguments ?

Yes

So this is optuna 🙂 the idea is it will test which parameters have potential (with early stopping), then launch a subset of the selected parameters

Ok, just my ignorance then? 🙂

Notice Optuna will do TPE & hyper band Bayesian optimization to find the best combination

It completed after the max_job limit (10)

Ok, just my ignorance then? 

LOL, no it is just that with a single discrete parameter the strategy makes less sense 🙂

It completed after the max_job limit (10)

Yep this is optuna "testing the water"

The Optimizer task is taking a lot of time to complete. Is it doing something here:

The "Optimizer task" will continue to run as long as there are sub-Tasks it launched.
Is anything else running/pending ?

No, all of them completed!

I am running from noebook and cell has returned

just that the task itself is still Running state

Ah ok there’s only optimizer.stop in the example

no task.close()

This one - https://github.com/allegroai/clearml/blob/master/examples/optimization/hyper-parameter-optimization/hyper_parameter_optimizer.py

Tried context provider for Task?

Something like:

with Task() as t: #train

I am running from noebook and cell has returned

Well the Task will close when you shut down the notebook 🙂

Tried context provider for Task?

I guess that would only make sense inside notebooks ?!

Yeah, Curious - is a lot of clearml usecases not geared for notebooks?

how do you see things being used as the most normal way?

Yeah, Curious - is a lot of clearml usecases not geared for notebooks?

That is somewhat correct, notebooks are not actually used with a lot of deep-learning projects as they require entire repository to support.
I guess generally speaking the workflow is, "test your code" (i.e. small scale with limited data), then clone and enqueue for remote execution.
That said, I think it will be great to expand the support.
TrickySheep9 I like the idea of context for Tasks, can you expand on how this is used as part of a (jupyter) workflow ?