Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
CostlyElephant1
Moderator
6 Questions, 16 Answers
  Active since 27 January 2023
  Last activity 2 months ago

Reputation

0

Badges 1

16 × Eureka!
0 Votes
4 Answers
203 Views
0 Votes 4 Answers 203 Views
Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!
Hi! had a basic question: I want to retrieve all tasks created by a clearml user ID (using Task.get_tasks() and filter). Is it possible to get user ID of the...
2 months ago
0 Votes
6 Answers
689 Views
0 Votes 6 Answers 689 Views
Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm
Hi everyone. I am working for the first time with ClearML. And I am trying to process some data using ClearML Data sdk and the public WebUI. I am experiencin...
one year ago
0 Votes
3 Answers
440 Views
0 Votes 3 Answers 440 Views
Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To
Hi there! I had a question regarding batch inference with clearml. I would like to serve a model using an inference task (containing the model and the code t...
6 months ago
0 Votes
1 Answers
678 Views
0 Votes 1 Answers 678 Views
Hi Again, I Was Wondering What Would Be A Good Practice With Respect To Saving Different Datasets (While Preprocessing It In Several Steps/Stages). Mainly With The Use Of Remove_Files(). Is It Ok To Delete Raw Data After Preprocessing For Example? In That
Hi again, I was wondering what would be a good practice with respect to saving different datasets (while preprocessing it in several steps/stages). Mainly wi...
one year ago
0 Votes
11 Answers
277 Views
0 Votes 11 Answers 277 Views
Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co
Hi again! I am doing batch inference from a parent task (that defines a base docker image). However, I've encountered an issue where the task takes several m...
4 months ago
0 Votes
4 Answers
298 Views
0 Votes 4 Answers 298 Views
Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti
Hello ClearML community! I have a question regarding batch inference using a base Docker image in ClearML. I have a Docker image that is configured with the ...
5 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14>
Yes, it was indeed in our code! after looking in depth, the loading of .cu and .cpp files was the root of the issue, slowing down the batch inference. Thanks a lot for your support!!

2 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Also, as can be seen in docker args, I tried using CLEARML_AGENT_SKIP_PIP_VENV_INSTALL and CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL, to avoid installing packages as the container conatins everything needed to run the task, but not sure that it had any effect.

4 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hello @<1523701205467926528:profile|AgitatedDove14> , thank you for addressing my concern. It seems that the aspect of avoiding the venv is functioning correctly, and everything within the container is properly configured to initiate. However, there is still a delay of approximately 2 minutes between the completion of setup, thus the appearance of the console log indicating "Starting Task Execution" and the actual commencement of the inference logic. During this period, no additional logs ar...

2 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Here it is @<1523701070390366208:profile|CostlyOstrich36>
Thanks for your feedback

4 months ago
0 Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To

I will try to create the base docker image using the "Exporting a Task into a Standalone Docker Container" section from
from None

6 months ago
0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

We are thinking to host our own server later on, so this wont be a problem in that case? but I was asking just know what was going on. thanks again

one year ago
0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

Hi John, on the fileserver

one year ago
0 Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Thanks for the fast reply! I will look into it.

5 months ago
0 Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Hi @<1523701205467926528:profile|AgitatedDove14> Thanks for your reply.
Is there any way to avoid creating a task to get the user ID?

2 months ago
0 Hi! Had A Basic Question: I Want To Retrieve All Tasks Created By A Clearml User Id (Using Task.Get_Tasks() And Filter). Is It Possible To Get User Id Of The Current User Configured In The Clearml.Config Using Clearml Python Api? Thanks In Advanced!

Yesss!! got the info I needed. Thanks a lot!!

2 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14> would you be so kind to take a look at this issue?
we still have 2 minutes between the log of
"

Starting Task Execution:

"
and actually starting our inference logic. We have no extra info from the log to check to improve this slow task start time.
thanks a lot for any feedback!

2 months ago
0 Hi There! I Had A Question Regarding Batch Inference With Clearml. I Would Like To Serve A Model Using An Inference Task (Containing The Model And The Code To Perform The Inference) As A Base To Be Cloned And Edited (Change Input Arguments), And Queue To

Hi Damjan, thank you for your message.
But If I understand correctly, that doc would be great for online serving. I am looking a solution for batch inference instead.

6 months ago
0 Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Hi again @<1523701070390366208:profile|CostlyOstrich36>
One further question. Is it possible also to avoid using a git project ? (given that the code could be already present inside the docker container).
hat would be the benefits of setting it in the clearml task config instead? thanks again!

4 months ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701205467926528:profile|AgitatedDove14> !
Thanks againg for following up this thread.

Perhaps It is not clear to read the delay in the log, but is just after "Starting Task Execution:"

Environment setup completed successfully
Starting Task Execution:

Here this new entry in the log is 2 min after env completed =>
1702378941039 box132 DEBUG 2023-12-12 11:02:16,112 - clearml.model - INFO - Selected model id: 9be79667ca644d7dbdf26732345f5415

So, the environment is creat...

2 months ago
0 Hi Everyone. I Am Working For The First Time With Clearml. And I Am Trying To Process Some Data Using Clearml Data Sdk And The Public Webui. I Am Experiencing A Lot Of Delay Getting The Dataset From Previous Tasks (Hours To Get 15Gb Of Data). Is This Norm

yes, the network seems fine. And it finally ends by getting the dataset. It just seems to hang more than it should between zips files.

one year ago
0 Hi Again! I Am Doing Batch Inference From A Parent Task (That Defines A Base Docker Image). However, I'Ve Encountered An Issue Where The Task Takes Several Minutes (Approximately 3-5 Minutes) Specifically When It Reaches The Stage Of "Environment Setup Co

Hi @<1523701070390366208:profile|CostlyOstrich36>
Did you have the time to check the full log I sent you?
Most appreciated!

4 months ago