Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Was Using Pipeline Controller To Run Pipeline Tasks With 2 Steps, The 1St Step Is Supposed To Create 51 Task And The 2Nd Task Will Compute Result Based On The 51St Tasks Output In The 1St Step. But I Only See 34 Tasks In Step 1, And Got Error Of The

Hi, I was using pipeline controller to run pipeline tasks with 2 steps, the 1st step is supposed to create 51 task and the 2nd task will compute result based on the 51st tasks output in the 1st step. But I only see 34 tasks in step 1, and got error of the rest tasks, they were not started and seems to be failed due to invalid task id.
There is no isssue if I run it locally, and it only happens when I have task number over 34 running remotely on AWS Autoscaler. Wondering if there is any setting to limit the number of task in pipeline step?

pipe.start_locally(run_pipeline_steps_locally=True)

Here is the error and logs

2025-04-16 07:07:12,854 - clearml.Task - ERROR - Action failed <400/101: tasks.get_by_id/v1.0 (Invalid task id: ids=(${generate_embedding_51))> (task=${generate_embedding_51)
2025-04-16 07:07:12,854 - clearml.Task - ERROR - Failed reloading task ${generate_embedding_51
  
  
Posted 4 months ago
Votes Newest

Answers


Hi @<1597762318140182528:profile|EnchantingPenguin77> , do you have a code snippet that reproduces this? Where is that API call originating from?

  
  
Posted 4 months ago