Thanks

AgitatedDove14

AgitatedDove14 It's hard to find to validate that.

I see. Dev tools is useful here for finding api endpoints used for the data and
https://github.com/allegroai/clearml/blob/master/clearml/task.py#L987 what I was looking for.
Thanks

I found system_tags and all the metrics including CPU but can't find any field mentions GPU scalar reported or GPU utilization.

How do I know what are possible options for status? Same for other parameters.
I don't see those in documentation.
https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all

I need to use this image in kubernetes

Thanks for the reply.
So, all requests should be post even when I'm trying to collect data?
For https://clear.ml/docs/latest/docs/references/api/workers#post-workersget_activity_report
when I am trying this
`
import requests, json
from requests.auth import HTTPBasicAuth

request_body = {
"from_date": "1665867715",
"interval": "3600",
"to_date": "1666213315"
}
url = web_server+"/workers.get_activity_report"

response = requests.get(url, auth=HTTPBasicAuth(access_key, secret_key)...

oh! my macos

I see. I am getting error in html output.
<noscript>Please enable JavaScript to continue using this application.</noscript>

` "tags": [],
"system_tags": [
"interactive"
],
"status_changed": "2022-10-13 17:05:22.844000+00:00",
"status_message": "",
"status_reason": "",
"last_worker": "xxx01:!2c1:cpu:10:service:0a750bd8a09b4063a59c96b4370d0815",
"last_worker_report": "2022-10-30 15:23:18.695000+00:00",
"last_update": "2022-10-30 15:23:18.695000+00:00",
"last_change": "2022-10-30 15:23:18.695000+00:00",
"last_iteration": 0,
"last_metrics": {
"29c6dd717a649...

Thanks SuccessfulKoala55
Also, https://clear.ml/docs/latest/docs/references/api/tasks#post-tasksget_all gives me userID

<tasks.Task: {
"id": "xxx",
"name": "Interactive Session",
"user": "6cfef1d32",
"company": "xxxx",
"type": "application",
"status": "in_progress",
.....

}
I can't find api endpoint to get user name from user_id like "user": "6cfef1d32" above.

ok

ok thanks

` from clearml.backend_api.session.client import APIClient

Create an instance of APIClient

client = APIClient()

users = client.users.get_all() `
I get

Traceback (most recent call last): File "get_all_users.py", line 13, in <module> users = client.users.get_all() AttributeError: 'APIClient' object has no attribute 'users'
Although,
user = Task._get_default_session().send_request("users", "get_all", json={"id": [user_id]})did the work.

How can it be even this kind of issue with Python when one endpoint is giving response and other not.

I am running virtual env too now

Worked with python:3.9.11 but didn't work with python:3.9.11-alpine 😮
This is crazy.

RUN apk update && apk upgrade --no-cache RUN /usr/local/bin/python3 -m pip install --upgrade pip RUN /usr/local/bin/python3 -m pip install -r requirements.txt

😕 I will using docker_image python:3.9-alpine
I am running a basic python script. Need to use clearml to use it's API

Yeah exactly. Scalar tab have those but I need to add track in the alert if GPU utilization/gpu memory not in use and experiment in progress then alert. Can I get gpu usage over time frame via API also?

I am missing something in this. Also, I want to use
https://clear.ml/docs/latest/docs/references/api/definitions#taskstask_urls
tasks.task_urls()
It doesn't mention request parameters in this.

` from clearml.backend_api.session.client import APIClient
from clearml import Task

Create an instance of APIClient

client = APIClient()

tasks = client.tasks.task_urls()
print (tasks)
Traceback (most recent call last):
File "get_all_users.py", line 15, in <module>
tasks = client.tasks....

same error for tasks.get_all() endpoint

Thanks

I found a lot of questions from past chat in this group including by you related to k8 glue with clearml.
Do you mean it recently become part of enterprise version?
AgitatedDove14

oh! yeah. That worked out. Thanks a lot.

AgitatedDove14 I found it's the issue with pycryptodome 😕
Error started coming from here. Maybe specific version of it. Digging more.
` #13 101.0 note: This error originates from a subprocess, and is likely not a problem with pip.
#13 101.0 ERROR: Failed building wheel for pycryptodome
#13 101.0 Running setup.py clean for pycryptodome
#13 104.9 Building wheel for numpy (pyproject.toml): started
#13 158.5 Building wheel for numpy (pyproject.toml): finished with status 'er...

This worked out.
`
from clearml.backend_api.session.client import APIClient

Create an instance of APIClient

client = APIClient()
project_list = client.workers.get_all()
print(project_list) `

My goal is to detect events when task does not uses allocated resources (e.g. GPU) for some period of time.
I am still trying to understand clearml api response.

Do you have any clue how can I get it from client.tasks.get_all(status=["in_progress"]) ?
If task has GPU allocated but not using it, would it be in in_progress status also? I want to collect those task.

I see task runtime info. I guess it's current utilization not allocation but not sure.

"runtime": {
"progress": "0",...

AgitatedDove14 I am upgrade upgrading pip before this. 😕