Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Moreover, When I Go To The Queue Page, I See The Queue Is Empty, But When I'M On The Queued Task'S Page I Can See It Is Enqueued To Right Right Queue... So The Task Says It Is In The Queue, But The Queue Says It Is Empty

Moreover, when I go to the queue page, I see the queue is empty, but when I'm on the queued task's page I can see it is enqueued to right right queue... So the task says it is in the queue, but the queue says it is empty

  
  
Posted 2 years ago
Votes Newest

Answers 17


WackyRabbit7 I might be missing something here, but the pipeline itself should be launched on the "pipelines" queue, is the pipeline itself running? or is it the step itself that is stuck in ""queued" state?

  
  
Posted 2 years ago

One sec I'll paste the relevant pieces of code

  
  
Posted 2 years ago

CostlyOstrich36

  
  
Posted 2 years ago

Do you need other part?

  
  
Posted 2 years ago

ClearML results page: Launching step: 2019-09-03_2021-01-25_choose_best Parameters: {***********} Configurations: None Overrides: None Launching step: 2019-10-23_2021-01-15_choose_best Parameters: {************} Configurations: None Overrides: None Launching step: 2019-05-26_2020-12-26_choose_best Parameters: {**********} Configurations: None Overrides: None Launching step: 2019-07-15_2021-01-05_choose_best Parameters: {************} Configurations: None Overrides: None Launching step: 2019-02-15_2021-02-04_choose_best Parameters: {**********} Configurations: None Overrides: None

  
  
Posted 2 years ago

Sounds like some issue with queueing the experiment. Can you provide a log of the pipeline?

  
  
Posted 2 years ago

one sec

  
  
Posted 2 years ago

and the step is "queued" or is it "queued" in the pipeline state (i.e. the visualization did not update) ?

  
  
Posted 2 years ago

the pipeline was running

  
  
Posted 2 years ago

but the task pending says its in the queue

  
  
Posted 2 years ago

CostlyOstrich36

  
  
Posted 2 years ago

I'll share some screenshots

  
  
Posted 2 years ago

queue looks empty

  
  
Posted 2 years ago

it's double weird, because also a task that the pipeline says is "in progress" is actually completed

  
  
Posted 2 years ago

` # define pipeline
pipe = clearml.PipelineController(
name=TASK_NAME,
project=PROJECT_NAME,
version='0.0.1',
add_pipeline_tags=False,
)
pipe.set_default_execution_queue('default')

Adding steps

pipe.add_step(name=f'{start_date_train}_{end_date_train}_choose_best',
base_task_project=CHOOSE_PROJECT_NAME,
base_task_name=CHOOSE_TASK_NAME,
parameter_override=params_override,
execution_queue='default')
...
...

Execute the controlling task on a different queue

pipe.start(queue="pipelines") `

  
  
Posted 2 years ago

How did you call the steps in the pipeline?

  
  
Posted 2 years ago

can't remember, I just restarted everything so I don't have this info now

  
  
Posted 2 years ago