i'm also not sure what this is
-H "Content-Type: application/octet-stream" -H' NV-InferRequest:batch_size: 1 input { name: "dense_input" dims: [-1, 784] } output { name: "activation_2" cls { count: 1 } }'

I am tagging AgitatedDove14 since I sort of need an answer asap...!

hi SuccessfulKoala55 with the clearml server update, does it use a newer ES docker?

Because sometimes it clones a cached version of a private repository, instead of cloning the requested version

I see, ok!
I will try that out.
Another thing I noticed: none of my pipeline tasks are reporting these graphs, regardless of runtime. I guess this line would also fix that?

i'm not sure how to double check this is the case when it happens... usually we have all requirements specified with git repo

Thanks!!

Sent it to you via DM!

Hi SuccessfulKoala55 , do you have an update on this?

Yeah, that would be nice!

Hi CostlyOstrich36
I added this instruction at the very end of my postprocess function
shutil.rmtree("~/.clearml")

I have this inside my pipeline defined with decorator

i don't think the conf is an issue. it's been deployed for a long time and working. models from yesterday correctly display the url

In fact I just did that yesterday. I'll let you know how it goes

AgitatedDove14 I noticed a lot of my tasks don't contain these graphs though...

I understand! this is my sysadmin message:
"if nothing else, they could publish a new elasticsearch image of 7.6.2 (ex. 7.6.2-1) which uses a newer patched version of JDK (1.13.x but newer than 1.13.0_2)"

this is the code that's giving me trouble 🤔

in particular, I ran the agent with clearml-agent daemon --queue test-concurrency --create-queue --services-mode 2 --docker "ubuntu:20.04" --detached and enqueued 4 tasks to it that sleep 15 minutes.
I can see all 4 tasks running, see

logger.report_media( title=name_title, series="Nan", iteration=0, local_path=fig_nan, delete_after_upload=delete_after_upload, ) clearml_task.upload_artifact( name=name_title, artifact_object=fig_nan, wait_on_upload=True, )

they are taking longer than 30 secs, but admittedly not much longer: 1-3 minutes

` Using cached repository in "/root/.clearml/vcs-cache/DeployKit_cloud.git.3e6952dd2fa4054e353465fe2d40daa3/DeployKit_cloud.git"

fatal: Could not read from remote repository. `

I am curious about the updates on version 1.0.0, where can I see some info regarding this?
Passing state information from pre to postprocessing and the dynamic preprocessing code thing, for example

Hey AgitatedDove14 , did you get a chance to look at this?

using clearML agent

Ok, going to ask the server admins, will keep you posted, thanks!

right, seems to have worked now!

um, this line is not doing anything for me 🤔
controller_clearml_task = Task.current_task() controller_clearml_task.set_resource_monitor_iteration_timeout( seconds_from_start=10 )

Right, I used --services-mode 2 and it still runs more than 2 tasks simultaneously

Ok gotchu. I'll do that as soon as I can.

Is this a possible future feature? I have used cometML before and they have this. I'm not sure how they do it though...