No, this is the first user in the brain company.

Sorry, my test environment crashed. I have to fix it first to reproduce the problem. 😓

How can I fresh DB? Mongo or Redis?

Hi TimelyPenguin76 , thanks for you reply. I still confuse about ClearML’s orchestration. Could you describe it in detail?

Thanks TimelyPenguin76 , I think I got it, but I have new questions when reading README of ClearML Agent. And I gave my questions in community just now, could you have a look at them? https://clearml.slack.com/archives/CTK20V944/p1626251661217200

Hi, TimelyPenguin76 , could you help me?

Thanks

Since k8s has no real priority/order the scheduling order is not guaranteed form this point.

K8s can schedule pod with different priorities. So maybe no real scheduling means there is no ClearML scheduling after applying pod to k8s.

only if it is sure there are enough resources to actually spin the job now

In 1.0.2 version, I do not find any logic about checking k8s resource in k8s.py. Does it will implement in the future?

I want to know the total fields(string reference mentioned above) which can be used as input of step2. Are these fields of ClearML Task?

Hi, SuccessfulKoala55 Maybe this is not a good question. In other words, docs introduce that ClearML Open Source supports orchestration, how can I found the relating codes? And what the role of clearml-agent in orchestration, a combination of kube-scheduler and kubelet?

Also - did you start with a fresh DB after changing the default company value?

No, I just restart the apiserver and webserver pod.

According to pipeline_from_functions.py , it is easy to understand that step1 returns data_frame and I can use it as input of step2. But I have no idea what string reference could be used when steps come from Task?

code

pipe.add_function_step(
    name='step_one',
    function=step_one,
    function_kwargs=dict(pickle_data_url='${pipeline.url}'),
    function_return=['data_frame'],
    cache_executed_step=True,
)
pipe.add_function_step(
    name='step_two',
    # parents=['st...

And no real scheduling in README exactly means that ClearML will not do scheduling for task which may provided in paid tier? In other words, Kubernetes will schedule the Pod for me. Is it right?

Got it!

README introduces that no real scheduling when using Kubernetes. But I think no matter launch a Pod or Job that the Pod will be scheduled through k8s scheduler exception specifying the nodeName in Pod specification. This confuses me a lot. What is the meaning of no real scheduling I don’t understand no verification of docker image

Thanks for your reply 😀 ！

Another question: can I mix steps with Task and Function?

What is meaning of ‘the scheduling is done before that’? Does it mean the ClearML will schedule the task for me?