CostlyElephant1

6 Questions, 16 Answers

Active since 27 January 2023

Last activity 8 months ago

Reputation

Badges 1

16 × Eureka!

Questions 6
Answers 16

0 Votes

11 Answers

727 Views

0 Votes 11 Answers 727 Views

Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi again! I am doing batch inference from a parent task (that defines a base docker image). However, I've encountered an issue where the task takes several m...

clearml

11 months ago

0 Votes

4 Answers

863 Views

0 Votes 4 Answers 863 Views

Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Hi! had a basic question: I want to retrieve all tasks created by a clearml user ID (using Task.get_tasks() and filter). Is it possible to get user ID of the...

clearml

9 months ago

0 Votes

4 Answers

756 Views

0 Votes 4 Answers 756 Views

Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Hello ClearML community! I have a question regarding batch inference using a base Docker image in ClearML. I have a Docker image that is configured with the ...

clearml

11 months ago

0 Votes

1 Answers

1K Views

0 Votes 1 Answers 1K Views

Hi Again, I Was Wondering What Would Be A Good Practice With Respect To Saving Different Datasets (While Preprocessing It In Several Steps/Stages). Mainly With The Use Of Remove_Files(). Is It Ok To Delete Raw Data After Preprocessing For Example? In That

Hi again, I was wondering what would be a good practice with respect to saving different datasets (while preprocessing it in several steps/stages). Mainly wi...

clearml

one year ago

0 Votes

6 Answers

1K Views

0 Votes 6 Answers 1K Views

Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

Hi everyone. I am working for the first time with ClearML. And I am trying to process some data using ClearML Data sdk and the public WebUI. I am experiencin...

clearml

one year ago

0 Votes

3 Answers

856 Views

0 Votes 3 Answers 856 Views

Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To

Hi there! I had a question regarding batch inference with clearml. I would like to serve a model using an inference task (containing the model and the code t...

clearml

one year ago

0 Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Thanks for the fast reply! I will look into it.

11 months ago

Hi again @<1523701070390366208:profile|CostlyOstrich36>
One further question. Is it possible also to avoid using a git project ? (given that the code could be already present inside the docker container).
hat would be the benefits of setting it in the clearml task config instead? thanks again!

11 months ago

0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

Hi John, on the fileserver

one year ago

0 Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Yesss!! got the info I needed. Thanks a lot!!

9 months ago

yes, the network seems fine. And it finally ends by getting the dataset. It just seems to hang more than it should between zips files.

one year ago

Hi @<1523701205467926528:profile|AgitatedDove14> Thanks for your reply.
Is there any way to avoid creating a task to get the user ID?

9 months ago

0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14>
Yes, it was indeed in our code! after looking in depth, the loading of .cu and .cpp files was the root of the issue, slowing down the batch inference. Thanks a lot for your support!!

8 months ago

0 Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To

Hi Damjan, thank you for your message.
But If I understand correctly, that doc would be great for online serving. I am looking a solution for batch inference instead.

one year ago

We are thinking to host our own server later on, so this wont be a problem in that case? but I was asking just know what was going on. thanks again

one year ago

I will try to create the base docker image using the "Exporting a Task into a Standalone Docker Container" section from
from None

one year ago

Here it is @<1523701070390366208:profile|CostlyOstrich36>
Thanks for your feedback

11 months ago

Also, as can be seen in docker args, I tried using CLEARML_AGENT_SKIP_PIP_VENV_INSTALL and CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL, to avoid installing packages as the container conatins everything needed to run the task, but not sure that it had any effect.

11 months ago

Hi @<1523701205467926528:profile|AgitatedDove14> !
Thanks againg for following up this thread.

Perhaps It is not clear to read the delay in the log, but is just after "Starting Task Execution:"

Environment setup completed successfully
Starting Task Execution:

Here this new entry in the log is 2 min after env completed =>
1702378941039 box132 DEBUG 2023-12-12 11:02:16,112 - clearml.model - INFO - Selected model id: 9be79667ca644d7dbdf26732345f5415

So, the environment is creat...

9 months ago

Hello @<1523701205467926528:profile|AgitatedDove14> , thank you for addressing my concern. It seems that the aspect of avoiding the venv is functioning correctly, and everything within the container is properly configured to initiate. However, there is still a delay of approximately 2 minutes between the completion of setup, thus the appearance of the console log indicating "Starting Task Execution" and the actual commencement of the inference logic. During this period, no additional logs ar...

9 months ago

Hi @<1523701205467926528:profile|AgitatedDove14> would you be so kind to take a look at this issue?
we still have 2 minutes between the log of
"

Starting Task Execution:

"
and actually starting our inference logic. We have no extra info from the log to check to improve this slow task start time.
thanks a lot for any feedback!

9 months ago

Hi @<1523701070390366208:profile|CostlyOstrich36>
Did you have the time to check the full log I sent you?
Most appreciated!

11 months ago