Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
CostlyElephant1
Moderator
6 Questions, 16 Answers
  Active since 27 January 2023
  Last activity 9 months ago

Reputation

0

Badges 1

16 × Eureka!
0 Votes
3 Answers
925 Views
0 Votes 3 Answers 925 Views
Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To
Hi there! I had a question regarding batch inference with clearml. I would like to serve a model using an inference task (containing the model and the code t...
one year ago
0 Votes
1 Answers
1K Views
0 Votes 1 Answers 1K Views
Hi Again, I Was Wondering What Would Be A Good Practice With Respect To Saving Different Datasets (While Preprocessing It In Several Steps/Stages). Mainly With The Use Of Remove_Files(). Is It Ok To Delete Raw Data After Preprocessing For Example? In That
Hi again, I was wondering what would be a good practice with respect to saving different datasets (while preprocessing it in several steps/stages). Mainly wi...
one year ago
0 Votes
4 Answers
954 Views
0 Votes 4 Answers 954 Views
Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!
Hi! had a basic question: I want to retrieve all tasks created by a clearml user ID (using Task.get_tasks() and filter). Is it possible to get user ID of the...
10 months ago
0 Votes
11 Answers
800 Views
0 Votes 11 Answers 800 Views
Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co
Hi again! I am doing batch inference from a parent task (that defines a base docker image). However, I've encountered an issue where the task takes several m...
one year ago
0 Votes
6 Answers
1K Views
0 Votes 6 Answers 1K Views
Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm
Hi everyone. I am working for the first time with ClearML. And I am trying to process some data using ClearML Data sdk and the public WebUI. I am experiencin...
one year ago
0 Votes
4 Answers
827 Views
0 Votes 4 Answers 827 Views
Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti
Hello ClearML community! I have a question regarding batch inference using a base Docker image in ClearML. I have a Docker image that is configured with the ...
one year ago
0 Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Hi again @<1523701070390366208:profile|CostlyOstrich36>
One further question. Is it possible also to avoid using a git project ? (given that the code could be already present inside the docker container).
hat would be the benefits of setting it in the clearml task config instead? thanks again!

one year ago
0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

We are thinking to host our own server later on, so this wont be a problem in that case? but I was asking just know what was going on. thanks again

one year ago
0 Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To

I will try to create the base docker image using the "Exporting a Task into a Standalone Docker Container" section from
from None

one year ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14> would you be so kind to take a look at this issue?
we still have 2 minutes between the log of
"

Starting Task Execution:

"
and actually starting our inference logic. We have no extra info from the log to check to improve this slow task start time.
thanks a lot for any feedback!

10 months ago
0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

yes, the network seems fine. And it finally ends by getting the dataset. It just seems to hang more than it should between zips files.

one year ago
0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

Hi John, on the fileserver

one year ago
0 Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Thanks for the fast reply! I will look into it.

one year ago
0 Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Yesss!! got the info I needed. Thanks a lot!!

10 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701070390366208:profile|CostlyOstrich36>
Did you have the time to check the full log I sent you?
Most appreciated!

one year ago
0 Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Hi @<1523701205467926528:profile|AgitatedDove14> Thanks for your reply.
Is there any way to avoid creating a task to get the user ID?

10 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14>
Yes, it was indeed in our code! after looking in depth, the loading of .cu and .cpp files was the root of the issue, slowing down the batch inference. Thanks a lot for your support!!

9 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hello @<1523701205467926528:profile|AgitatedDove14> , thank you for addressing my concern. It seems that the aspect of avoiding the venv is functioning correctly, and everything within the container is properly configured to initiate. However, there is still a delay of approximately 2 minutes between the completion of setup, thus the appearance of the console log indicating "Starting Task Execution" and the actual commencement of the inference logic. During this period, no additional logs ar...

10 months ago
0 Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To

Hi Damjan, thank you for your message.
But If I understand correctly, that doc would be great for online serving. I am looking a solution for batch inference instead.

one year ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Here it is @<1523701070390366208:profile|CostlyOstrich36>
Thanks for your feedback

one year ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Also, as can be seen in docker args, I tried using CLEARML_AGENT_SKIP_PIP_VENV_INSTALL and CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL, to avoid installing packages as the container conatins everything needed to run the task, but not sure that it had any effect.

one year ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14> !
Thanks againg for following up this thread.

Perhaps It is not clear to read the delay in the log, but is just after "Starting Task Execution:"

Environment setup completed successfully
Starting Task Execution:

Here this new entry in the log is 2 min after env completed =>
1702378941039 box132 DEBUG 2023-12-12 11:02:16,112 - clearml.model - INFO - Selected model id: 9be79667ca644d7dbdf26732345f5415

So, the environment is creat...

10 months ago