Or if it wasn't clear, that chunk of code is from clearml's dataset.py

SuccessfulKoala55 it does not

Thanks!

I've been answering there as well 🤕

Thanks! To clarify, all the agent does is then spawn new nodes to cover the tasks?

None, they're unusable for us.

Any updates @<1523701087100473344:profile|SuccessfulKoala55> ? 🫣

Honestly I wouldn't mind building the image myself, but the glue-k8s setup is missing some documentation so I'm not sure how to proceed

No task, no dataset, just an empty container with no reference to the task it's attached.

It seems to me that it should not move the task if use_current_task=True ?

I believe that happens natively thanks to pyhocon? No idea why it fails on mac

I guess I'll have to rerun the experiment without tags for this?

Thanks for the reply @<1523701827080556544:profile|JuicyFox94> ! I'll debug more and let you know

Running a self-hosted server indeed. It's part of a code that simply adds or uploads an artifact 🤔

So the pipeline runs successfully, I can find all the different tasks, but I cannot see them in the Pipelines tab…

Happens with the latest version indeed.
I can’t share our code, but the gist of it is:

pipe = PipelineController(name=..., project=..., version=...)

pipe.add_function_step(...)  # Many calls

pipe.set_default_execution_queue(...)
pipe.start(queue=..., wait=True)

I believe that a Pipeline should have the system tags ( pipeline , maybe hidden ), even if it created in a running Task .

I can navigate through the projects, but selecting one task in one project, then navigating to another project and selecting a different task -> there is no suggestion to compare the tasks.

In the projects page if I show all - I just see the projects. If I search for a task of similar name, I get results, but I can't compare them via the UI.

The only way I managed so far was to create a pseudo-comparison between unrelated tasks in the same project, then remove one task from comparion, and u...

Hey AgitatedDove14 🙂
Finally managed; you keep saying "all projects" but you meant the "All Experiments" project instead. That's a good start 👍 Thanks!

Couple of thoughts from this experience:
Could we add a comparison feature directly from the search results (Dashboard view -> search -> highlight some experiments for comparison)? Could we add a filter on the project name in the "All Experiments" project? Could we add the project for each of the search results? (see above pictur...

Unfortunately I can't take a photo of not being able to compare tasks by navigating around the WebUI...

Does that clarify the issue CostlyOstrich36 ?

That's exactly what I meant AgitatedDove14 🙂 It's just that to access that comparison page, you have to make a comparison first. It would be handy to have a link (in the side bar?) to an empty comparison

I can't seem to manage the first way around. If I select tasks in different projects, I don't get the bottom bar offering to compare between them

For example, can't interact with these two tasks from this view (got here from searching in the dashboard view; they're in different projects):

Either, honestly, would be great. I meant even just a link to a blank comparison and one can then add the experiments from that view

Ah okay 😄 Was confused by what you quoted haha 👍

Hmmm, what 😄

Nothing I can spot --

ClearML results page: 

ClearML pipeline page: 

Launching the next 2 steps
Launching step [...]
Launching step [...]
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
Launching step: ...
Parameters:
{...}
Configurations:
{}
Overrides:
{}
ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
2023-02-21 13:53:48
ClearML Monitor: Could not detect iteration reporting, falling back to itera...

When I use the APIClient to fetch the tags for the project, I get an empty collection of system tags:

<projects.GetProjectTagsResponse: {
    "tags": [],
    "system_tags": []
}>

@<1523701070390366208:profile|CostlyOstrich36> I added None btw

Ah I see, if the pipeline controller begins in a Task it does not add the tags to it…

FWIW running clearml ==1.9.1 with WebApp: 1.9.2-317 • Server: 1.9.2-317 • API: 2.23