AgitatedDove14 , I will try it with latest version. But why the url in es is different from it in web UI? I have checked the codes that evnets.debug_images api which will return url to web UI will get the url from es.

code commit

Thanks

Thanks a lot! I’ ll replace credentials with new user in assigned to a new company ID to call users.get_all again.

Thanks TimelyPenguin76 , I think I got it, but I have new questions when reading README of ClearML Agent. And I gave my questions in community just now, could you have a look at them? https://clearml.slack.com/archives/CTK20V944/p1626251661217200

For example, I have a lot of tasks in a queue, but there is a default agent(services, mode = daemon) after using helm to deploy the ClearML in Kubernetes. As far as I know, agent will pull and execute the task in specified queue one by one, which results in other tasks are blocked. However, the physical resource is enough in cluster. So how can ClearML to improve the efficiency of execution? I can solve it by implementing a custom scheduler which is used to watch the queue, pull the task and...

I want to know the total fields(string reference mentioned above) which can be used as input of step2. Are these fields of ClearML Task?

Hi  AgitatedDove14 ,I try it with Clearml 1.1.4, but it fails again.

Do you use ClearML Open Source?

Since k8s has no real priority/order the scheduling order is not guaranteed form this point.

K8s can schedule pod with different priorities. So maybe no real scheduling means there is no ClearML scheduling after applying pod to k8s.

only if it is sure there are enough resources to actually spin the job now

In 1.0.2 version, I do not find any logic about checking k8s resource in k8s.py. Does it will implement in the future?

Thanks for your reply 😀 ！

Hi TimelyPenguin76 , thanks for you reply. I still confuse about ClearML’s orchestration. Could you describe it in detail?

I meet the same problem.
I curl elastic and get the following result(picture 1).
I check the response of debug images from web UI, and I get the picture2.

version

I deploy clearml in 1.1.1 with helm, and use 1.0.4 clearml package.

Hi, SuccessfulKoala55 Maybe this is not a good question. In other words, docs introduce that ClearML Open Source supports orchestration, how can I found the relating codes? And what the role of clearml-agent in orchestration, a combination of kube-scheduler and kubelet?

Are you sending these requests manually?
COK. In any case, you should be looking at the

I send them with curl.

I have another question. Does the following apis in the picture are served by both of apiserver and webserver, or just one of them ?

According to pipeline_from_functions.py , it is easy to understand that step1 returns data_frame and I can use it as input of step2. But I have no idea what string reference could be used when steps come from Task?

code

pipe.add_function_step(
    name='step_one',
    function=step_one,
    function_kwargs=dict(pickle_data_url='${pipeline.url}'),
    function_return=['data_frame'],
    cache_executed_step=True,
)
pipe.add_function_step(
    name='step_two',
    # parents=['st...

which collection?

Got it!

Hi BurlySeagull48 AgitatedDove14 , does upgrading clearml package and images to 1.0.4 really work? https://clearml.slack.com/archives/CTK20V944/p1628112607184300?thread_ts=1628108536.180100&cid=CTK20V944

In any case, the said credentials are valid for the company ID defined using 

apiserver.default_company

It really works for apiserver, but webserver does not have the default_company configuration.

In any case the user associated with the credentials you use is not assigned to the same cinoany ID you replaced

More in detail?

How can I fresh DB? Mongo or Redis?

Another question: can I mix steps with Task and Function?

I have a similar question. I want to extend the authorization of clearml, but I have no idea about it according to docs. By the way, is it possible to implement the custom authorization based on the basic authz api in clearml? Or does clearml support it?

But you’re not using the webserver, you’re sending the cURL requests manually, aren’t you?

yes, I send them manully.

I check it with the following result:

action:

auth.create_user

mongo:

see picture

apiserver logs:
`[2022-05-17 10:02:50,024] [8] [WARNING] [clearml.service_repo] Returned 400 for auth.create_user in 8ms, msg=Value combination already exists: email=

`

Hi, TimelyPenguin76 , could you help me?