@<1523701070390366208:profile|CostlyOstrich36> I added None btw
I believe that a Pipeline should have the system tags ( pipeline
, maybe hidden
), even if it created in a running Task
.
@<1523701087100473344:profile|SuccessfulKoala55> , what is the intended behavior?
Ah I see, if the pipeline controller begins in a Task it does not add the tags to it…
When I use the APIClient
to fetch the tags for the project, I get an empty collection of system tags:
<projects.GetProjectTagsResponse: {
"tags": [],
"system_tags": []
}>
FWIW running clearml
==1.9.1
with WebApp: 1.9.2-317 • Server: 1.9.2-317 • API: 2.23
So the pipeline runs successfully, I can find all the different tasks, but I cannot see them in the Pipelines tab…
Nothing I can spot --
ClearML results page:
ClearML pipeline page:
Launching the next 2 steps
Launching step [...]
Launching step [...]
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
2023-02-21 13:53:48
ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start
2023-02-21 13:55:13
Launching the next 0 steps
2023-02-21 13:55:48
Launching the next 1 steps
Launching step [...]
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
2023-02-21 13:57:39
Launching the next 0 steps
2023-02-21 13:57:49
Process completed successfully
and if you revert it's all OK? Log wise there is nothing suspicious?
Happens with the latest version indeed.
I can’t share our code, but the gist of it is:
pipe = PipelineController(name=..., project=..., version=...)
pipe.add_function_step(...) # Many calls
pipe.set_default_execution_queue(...)
pipe.start(queue=..., wait=True)
Hi @<1523701083040387072:profile|UnevenDolphin73> , does it happen with the latest version? Can you add a snippet that reproduces this?