ClearML FAQ | Hi All, I Am Trying To Get All Pipeline Tasks Or Task Ids From A Specific Project. The Project In The Details Of One Of The Pipeline Tasks Is Defined As

Answered

Hi All, I Am Trying To Get All Pipeline Tasks Or Task Ids From A Specific Project. The Project In The Details Of One Of The Pipeline Tasks Is Defined As

Hi all, I am trying to get all pipeline tasks or task ids from a specific project. The project in the details of one of the pipeline tasks is defined as "<project_name>/.pipelines/<pipeline_name>" . I get:
Task.query_tasks(project_name="<project_name>/.pipelines/<pipeline_name>") -> []
Task.get_tasks(project_name="<project_name>/.pipelines/<pipeline_name>") -> []
APIClient.client.projects.get_all(name="<project_name>/.pipelines/<pipeline_name>") -> empty Project list
but
Task.query_tasks(task_name="<pipeline_name>") -> list of task ids
Task.get_tasks(task_name="<pipeline_name>") -> list of tasks
APIClient.client.projects.get_all(id=["id of <project_name>/.pipelines/<pipeline_name>"]) -> Project with name="<project_name>/.pipelines/<pipeline_name>"
Why can't I get the tasks of this pipeline project or even the project by name? Are pipelines not handled like projects? Is there a way to get all pipeline tasks in a project?

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					UnevenSquirrel80
				
					0
					 × 1

Votes Newest

Answers 2

Hi @<1679661969365274624:profile|UnevenSquirrel80> ! Pipeline projects are hidden. You can try to pass task_filter={"search_hidden": True, "_allow_extra_fields_": True} to the query_tasks function to fetch the tasks from hidden projects

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					SmugDolphin23
				
					0

Nice, works! Thank you @<1523701435869433856:profile|SmugDolphin23>

  				
Posted 
	8 months ago

					More
				  		
  Report
		
					UnevenSquirrel80
				
					0
					 × 1

Write your answer

536 Views

2 Answers

8 months ago

8 months ago

Tags

Similar posts

Hi Everyone! I Am Using Clearml Pipeline For Retraining Purpose, I Just Want To Ask Why Model From Retraining Process Is Stored Under Project "Project_Name/.Pipeline/Pipeline_Name" ? How Do I Make It To Store The Model To "Project_Name" Instead Of "Proje

As Soon As I Refactor My Project Into Multiple Folders, Where On Top-Level I Put My Pipeline File, And Keep My Tasks In A Subfolder, The Clearml Agent Seems To Have Problems:

Hi Guys, I Recently Started Working On Clearml. I Have A Pipeline Which Has Couple Of Tasks Added To It. The Pipeline Executes And Completes As Expected When I Use The Web App. I Am Trying To Start This Pipeline From The Sdk Api. I Have A Two Part Questio

I'M Trying To Read The Runtimes Of Tasks After The Pipeline Finished, For Analytics. Currently, I'M Doing Something Like This:

Hi Everyone, I Noticed A Weird Issue With Pipeline Tasks. I Have A Task In My Project With Configuration That Includes Several Parameters Of Different Types (Strings, Ints, Bools). As Soon As I Use This Task To Create A Pipeline Task Using

Hello Everyone! I Have A Pipeline That Stores A Metric X (A Single Number) At The End And I Want To Display A Graph Of This Metric In Project Dashboard, So That I Can See How It Changes With Each Pipeline Run And Get A Slack Notification If The Value Of T

I Have A Pydantic Class For My Pipeline Params (That Verifies Integrity Of Booleans, Strings, Emails, Aws-Intance-Ids And Such). I Want To Use Tihs Class To Verify The Parameters Integrity Before Passing Them To My Pipeline, Both From Code And From Ui (Wh

Hi All, I Have A Query Regarding The Retrieval Of Pipeline Details. I Have Already Created A Pipeline Under The Project Name "<Project_Name>" And The Pipeline Name Is "<Pipeline_Name>". I Would Like To Retrieve The Version Of This Pipeline. I Tried Using

Hi There, Currently I Have A Clearml Pipeline That Takes In A Bunch Of Parameters For Various Tasks And Passes These Parameters Via Parameter_Override For Every Pipe.Add_Step(). However, I Have A Lot Of Parameters, And So My Pipeline Code Is A Little Unwi

We Do Want To Have Control Which Files Are Logged In The Model Registry. There Is Such Option In Task.Init(), Auto_Connect_Frameworks=False Or Injecting A Dict() To It.. But Our Tasks Are Created As Being Part Of A Pipeline With Add_Function_Step(). So We