Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Can We Specify The Limit And Request Resource Differently For The Workers Spawned By The Clearml Agent? So Some Tasks May Require A Lot Of Ram, But Other Tasks Don'T. So I Don'T Them To All Request The Same Amount Of Resource To Run. Edit: My Clearml

Hi,
Can we specify the limit and request resource differently for the workers spawned by the clearml agent? So some tasks may require a lot of RAM, but other tasks don't. So I don't them to all request the same amount of resource to run.
Edit: my clearml agent is running in k8s and it spawn worker pod to run the tasks in queue

  
  
Posted 2 years ago
pic
More
GrittyCormorant73
0 × 1
Report
Votes Newest

Answers 6

Hi GrittyCormorant73 ,

Did you define a single queue or multiples?

  
  
Posted 2 years ago
pic
More
CostlyOstrich36
0
Report

CostlyOstrich36 Hi John, right now I define single queue. So you mean I can deploy multiple agents, each with different resource request and listen on different queue, right? I think that could work

  
  
Posted 2 years ago
pic
More
GrittyCormorant73
0 × 1
Report

Yes, you can 🙂

  
  
Posted 2 years ago
pic
More
CostlyOstrich36
0
Report

You can even decide individually per step

  
  
Posted 2 years ago
pic
More
CostlyOstrich36
0
Report

Oh, and when I create pipeline, it looks like it create a task for the pipeline itself, and each step is run as a task. I can also put the pipeline and each steps on different queue independently, right? Look like it's possible CostlyOstrich36

  
  
Posted 2 years ago
pic
More
GrittyCormorant73
0 × 1
Report

Yes, I think that would be the best solution.

  
  
Posted 2 years ago
pic
More
CostlyOstrich36
0
Report
Write your answer
1K Views
6 Answers
2 years ago
one year ago
Tags
mlops