TimelyMouse69 Hello, could you help check my above questions? Thanks.

CostlyOstrich36 It's because the ports are used by other services.

CostlyOstrich36 Thanks.
I installed ClearML-Agent to run it. However, I encounter another issue.

It shows the error message of

clearml_agent: ERROR: [Errno 2] No such file or directory: '/root/.clearml/venvs-builds/3.8/task_repository/PyTorch.git/ctbc/image_classification_CIFAR10.py'

I've executed https://github.com/allegroai/clearml/blob/master/examples/frameworks/pytorch/notebooks/image/image_classification_CIFAR10.ipynb before executing https://github.com/allegroai/clearml/blo...

I found the document that I can use base_task_id .
None

Hi SweetBadger76
For example, I want to compare accuracy (the metrics I'm interested) among different experiments. This metrics isn't automatically recorded by ClearML so I want to manually record it.
I've found a workaround to achieve it (as mentioned in the original message), but I'm still wondering if there is any suggestion except using logger.report_scalar ?

Hi SuccessfulKoala55 Do u mean give you the code to plot the image (but not including the data) or the image or the experiment I encountered this performance issue?

SweetBadger76 Thanks! Waiting for your example.

SweetBadger76 Thanks.

CostlyOstrich36 Thanks.
I'm not sure how I can do it if I don't use the ClearML agent. In https://clear.ml/docs/latest/docs/references/sdk/scheduler/#class-automationtaskscheduler , I can't find how to stop it programmatically. Could I stop it by the UI if I don't use the ClearML agent. I see. In my understanding, the log would show all the message, but not so clear to me. Especially, if I have tens or hundreds of scheduled tasks. It's not convenient for me to check one by one.

Is there any update?

agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = /root/.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = /root...

AbruptCow41 Hi, thanks.

I follow this tutorial - https://clear.ml/docs/latest/docs/guides/frameworks/pytorch/notebooks/image/hyperparameter_search/ , but I didn't see it told me to add any repository.

Also, what I execute as a base experiment is https://github.com/allegroai/clearml/blob/master/examples/frameworks/pytorch/notebooks/image/image_classification_CIFAR10.ipynb , not image_classification_CIFAR10.py. Does the https://clear.ml/docs/latest/docs/references/sdk/hpo_optimization_hyp...

CostlyOstrich36 https://app.clear.ml/projects/aa8fcc0a06b045868b019a551ae073b4/experiments/edb6696a04a44a9c8dcf1ff809a2163c/output/execution

TimelyMouse69
Yeah, there is no further explanation about the status of closed so I'm wondering when it can become closed . As for my second question, my intention is that no need to update the original task or create a new task for another training. I expect that I can do another training after task.close() and I won't encounter any issues, but I'm wrong.

TimelyMouse69 About the closed status, I'll wait for your response. Thanks!!

TimelyMouse69 Thanks.
About question #2,
I don't want to reuse a task. I want to temporarily pause or permanently stop this ClearML task so the ClearML task won't record my following experiment (training job).

CostlyOstrich36 Thanks! I'll try it.

SuccessfulKoala55 I don't understand your meaning.

CostlyOstrich36 Ok. Thanks.

SuccessfulKoala55 Ok. Here is my code. Thanks.
` def plot_feature_scatter(df1, df2, features):
i = 0
sns.set_style("whitegrid")
plt.figure

fig, ax = plt.subplots(5, 4, figsize=(20, 20))

for feature in features:
    i += 1
    plt.subplot(5, 4, i)
    plt.scatter(df1[feature], df2[feature], marker="+", color='#2B3A67', alpha=0.2)
    plt.xlabel(feature, fontsize=9)
    
plt.show()

plot_feature_scatter(train_df.sample(50000), test_df.samp...

SuccessfulKoala55 The image is something like this.
My questions are two
Is it possible to let ClearML not record this plot manually? Doesn't ClearML have performance issue for this kind of plot?

SuccessfulKoala55 No, I don't know how to turn off and turn on the auto-logging. Could you tell me? Thanks.

I see! Thanks AnxiousSeal95 and SweetBadger76 !

I have another related questions. Are the items in + metric I can select only the items in Results -> Scalars .

TimelyMouse69
Ok. It's strange. After executing mark_completed() , the kernel of Jupyter is dead. You can see the following image. The three cells (3~5) run at once, then the kernel is dead. I use task.close() but the status is still completed , not closed .

TimelyMouse69 Hello, could you help check the above messages ? Thanks.