ubuntu

SuccessfulKoala55 thank you for the response; what about the second part of question (stopping)?

But stucks at the same moment when using docker

Can I do this to specify which worker should execute that task?
CLEARML_WORKER_NAME=<worker_name> clearml-agent execute --id <task_id>

Hmm, it is hard to specify the way

clearml_agent: ERROR: Instance with the same WORKER_ID [our_machine:gpu0] is already running

I am referring to something like Ray framework has https://docs.ray.io/en/latest/ray-core/tasks.html#specifying-required-resources

No. I would like to use TaskScheduler for pipelines. For now it seems to me, that I need to firstly run whole pipeline to get it's id.

I would like to define the pipeline but not run it before it is run by the scheduler

Just like in example: https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_from_tasks.py

AgitatedDove14 how does the Agent know which git repo from my account to clone for execution?

ClearML Server Version: 1.7.0-232

https://github.com/allegroai/clearml/issues/864

when is server created on my local machine, when I do clearml-init ?

no, it is everything on my local machine

it still stucks at the same moment

no

I haven't change any port mapping

Ill try...

this Point class is in repo

In fact, as I assume, we need to write our custom HyperParameterOptimizer, am I right?

clearml-agent daemon --docker --foreground --debug
usage: clearml-agent [-h] [--help] [--version] [--config-file CONFIG_FILE] [--debug]
{execute,build,list,daemon,config,init} ...
clearml-agent: error: unrecognized arguments: --debug

CostlyOstrich36 have you ever seen something like my case maybe?

I am using UI and I am clicking select all. If it is calling API server then yes

AgitatedDove14 in fact in our case we want to use simple strategies, RandomSearch is enough, but the problem is that we need to change the ranges dynamically

Commits, that are not pushed to the repo

AgitatedDove14 one more question regarding this issue
Is it possible to change parameter space dynamically.
(dummy) example:
Our optimization is a task when we sample from [1,2,3] twice. At the situation when 3 is chosen twice, eliminate 3 from one sampling range, so make the sampling x1 from [1,2,3] and x2 from [1,2]

Regarding this last question - I know that there is possibility to set up some budget - for example seconds of running after which optimization stops. But is there a possibility to specify a boolean condition when work should stop?

or at least I can't specify such

hmm, this might be a problem....

SuccessfulKoala55 Thank you for the response! Let me elaborate a bit to check if I understand this correctly.
We have a time-consuming task T based on optimization for parameters. We want to run hyperparameter optimization for T, suppose that we want to run it for 100 sets of parameters.
We want to leverage the fact that we have n machines to make the work parallel.

So for that we use https://clear.ml/docs/latest/docs/references/sdk/hpo_optimization_hyperparameteroptimizer/ , we run Agent...