Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Pipelines Suddenly No Longer Appear In The Pipelines Tab, What Could/Should I Look Into? Edit: Using Latest Clearml (Agent, Server, Sdk), And Creating The Pipelines Via The Pipelinecontroller Sdk (

Pipelines suddenly no longer appear in the Pipelines tab, what could/should I look into?
EDIT: Using latest ClearML (agent, server, SDK), and creating the pipelines via the PipelineController SDK ( not the decorator)

  
  
Posted one year ago
Votes Newest

Answers 11


Hi @<1523701083040387072:profile|UnevenDolphin73> , does it happen with the latest version? Can you add a snippet that reproduces this?

  
  
Posted one year ago

Happens with the latest version indeed.
I can’t share our code, but the gist of it is:

pipe = PipelineController(name=..., project=..., version=...)

pipe.add_function_step(...)  # Many calls

pipe.set_default_execution_queue(...)
pipe.start(queue=..., wait=True)
  
  
Posted one year ago

and if you revert it's all OK? Log wise there is nothing suspicious?

  
  
Posted one year ago

Nothing I can spot --

ClearML results page: 

ClearML pipeline page: 

Launching the next 2 steps
Launching step [...]
Launching step [...]
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
2023-02-21 13:53:48
ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start
2023-02-21 13:55:13
Launching the next 0 steps
2023-02-21 13:55:48
Launching the next 1 steps
Launching step [...]
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
2023-02-21 13:57:39
Launching the next 0 steps
2023-02-21 13:57:49
Process completed successfully
  
  
Posted one year ago

So the pipeline runs successfully, I can find all the different tasks, but I cannot see them in the Pipelines tab…

  
  
Posted one year ago

FWIW running clearml ==1.9.1 with WebApp: 1.9.2-317 • Server: 1.9.2-317 • API: 2.23

  
  
Posted one year ago

When I use the APIClient to fetch the tags for the project, I get an empty collection of system tags:

<projects.GetProjectTagsResponse: {
    "tags": [],
    "system_tags": []
}>
  
  
Posted one year ago

Ah I see, if the pipeline controller begins in a Task it does not add the tags to it…

  
  
Posted one year ago

@<1523701087100473344:profile|SuccessfulKoala55> , what is the intended behavior?

  
  
Posted one year ago

I believe that a Pipeline should have the system tags ( pipeline , maybe hidden ), even if it created in a running Task .

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36> I added None btw

  
  
Posted one year ago
939 Views
11 Answers
one year ago
one year ago
Tags