Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey, While Trying To Run A Pipeline With The Pipelinedecorator Scheme, I Encounter The Following Error: Traceback (Most Recent Call Last): File "C:\Users\*****\Documents\*****\\*****\Mlops\Tasks\Preprocessing\Insert_Missing_Rows_Based_On_Stock.Py", Lin

Hey,
while trying to run a pipeline with the PipelineDecorator scheme, I encounter the following error:

Traceback (most recent call last):
File "C:\Users*\Documents*\\mlops\tasks\preprocessing\insert_missing_rows_based_on_stock.py", line 48, in <module>
main(params['dataset_project'], params['dataset_name'], params['dataset_file_name'], params['file_dtypes'], params['file_dates'])
File "C:\Users\
\anaconda3\envs\
\lib\site-packages\clearml\automation\controller.py", line 4005, in internal_decorator
a_pipeline._task.execute_remotely(queue_name=pipeline_execution_queue)
File "C:\Users\***\anaconda3\envs\
\lib\site-packages\clearml\task.py", line 2520, in execute_remotely
Task.enqueue(task, queue_name=queue_name)
File "C:\Users\
\anaconda3\envs\**\lib\site-packages\clearml\task.py", line 1276, in enqueue
raise ValueError('Could not find queue named "{}"'.format(queue_name))
ValueError: Could not find queue named "services"

Process finished with exit code 1

my main contain the row:

PipelineDecorator.set_default_execution_queue(default_execution_queue='cpu-driven')

so i wonder whats the problem

  
  
Posted one year ago
Votes Newest

Answers 7


I don't think so, but it's worth to try 🙂

  
  
Posted one year ago

yes,
so basically I should create a services queue, and preferably let it contain its own workers

  
  
Posted one year ago

Happy to help 🙂

  
  
Posted one year ago

ok, yeah, makes sense. thanks John!

  
  
Posted one year ago

another question: if i save heavy artifcats, should my services worker ram be at least as high? (or is it enough for the default queue workers to have that)

  
  
Posted one year ago

Yes. But the services queue doesn't need a GPU, just a simple CPU machine to handle the controllers which don't take much resources (unless you did something crazy inside the controller like heavy computation)

  
  
Posted one year ago

Hi @<1544853695869489152:profile|NonchalantOx99> , as the error states:

    raise ValueError('Could not find queue named "{}"'.format(queue_name))
ValueError: Could not find queue named "services"

It couldn't find the queue services. This is for the pipeline controller to run on. Pipelines consist of steps and the controller and they all can run on different machines. By default, the controller will try to run on the services queue. Makes sense? 🙂

  
  
Posted one year ago
1K Views
7 Answers
one year ago
one year ago
Tags