ClearML FAQ | Hi All, I Am Trying To Get All Pipeline Tasks Or Task Ids From A Specific Project. The Project In The Details Of One Of The Pipeline Tasks Is Defined As

Answered

Hi All, I Am Trying To Get All Pipeline Tasks Or Task Ids From A Specific Project. The Project In The Details Of One Of The Pipeline Tasks Is Defined As

Hi all, I am trying to get all pipeline tasks or task ids from a specific project. The project in the details of one of the pipeline tasks is defined as "<project_name>/.pipelines/<pipeline_name>" . I get:
Task.query_tasks(project_name="<project_name>/.pipelines/<pipeline_name>") -> []
Task.get_tasks(project_name="<project_name>/.pipelines/<pipeline_name>") -> []
APIClient.client.projects.get_all(name="<project_name>/.pipelines/<pipeline_name>") -> empty Project list
but
Task.query_tasks(task_name="<pipeline_name>") -> list of task ids
Task.get_tasks(task_name="<pipeline_name>") -> list of tasks
APIClient.client.projects.get_all(id=["id of <project_name>/.pipelines/<pipeline_name>"]) -> Project with name="<project_name>/.pipelines/<pipeline_name>"
Why can't I get the tasks of this pipeline project or even the project by name? Are pipelines not handled like projects? Is there a way to get all pipeline tasks in a project?

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					UnevenSquirrel80
				
					0
					 × 1

Votes Newest

Answers 2

Hi @<1679661969365274624:profile|UnevenSquirrel80> ! Pipeline projects are hidden. You can try to pass task_filter={"search_hidden": True, "_allow_extra_fields_": True} to the query_tasks function to fetch the tasks from hidden projects

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					SmugDolphin23
				
					0

Nice, works! Thank you @<1523701435869433856:profile|SmugDolphin23>

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					UnevenSquirrel80
				
					0
					 × 1

Write your answer

600 Views

2 Answers

9 months ago

9 months ago

Tags

Similar posts

Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin

Hi, Does Anyone Know How To Clone Every Step Of A Pipeline To A Project? I'M Doing This To Save All Execution Results And Compare Them With Previous Versions. I Can Achieve This By Running My Pipeline.Py Script, But It Doesn'T Work When I Execute The Same

Hi Everyone! I Am Using Clearml Pipeline For Retraining Purpose, I Just Want To Ask Why Model From Retraining Process Is Stored Under Project "Project_Name/.Pipeline/Pipeline_Name" ? How Do I Make It To Store The Model To "Project_Name" Instead Of "Proje

As Soon As I Refactor My Project Into Multiple Folders, Where On Top-Level I Put My Pipeline File, And Keep My Tasks In A Subfolder, The Clearml Agent Seems To Have Problems:

Hi Guys, I Recently Started Working On Clearml. I Have A Pipeline Which Has Couple Of Tasks Added To It. The Pipeline Executes And Completes As Expected When I Use The Web App. I Am Trying To Start This Pipeline From The Sdk Api. I Have A Two Part Questio

I'M Trying To Read The Runtimes Of Tasks After The Pipeline Finished, For Analytics. Currently, I'M Doing Something Like This:

Hi Everyone, I Noticed A Weird Issue With Pipeline Tasks. I Have A Task In My Project With Configuration That Includes Several Parameters Of Different Types (Strings, Ints, Bools). As Soon As I Use This Task To Create A Pipeline Task Using

Hello Everyone! I Have A Pipeline That Stores A Metric X (A Single Number) At The End And I Want To Display A Graph Of This Metric In Project Dashboard, So That I Can See How It Changes With Each Pipeline Run And Get A Slack Notification If The Value Of T

I Have A Pydantic Class For My Pipeline Params (That Verifies Integrity Of Booleans, Strings, Emails, Aws-Intance-Ids And Such). I Want To Use Tihs Class To Verify The Parameters Integrity Before Passing Them To My Pipeline, Both From Code And From Ui (Wh

Hi All, I Have A Query Regarding The Retrieval Of Pipeline Details. I Have Already Created A Pipeline Under The Project Name "<Project_Name>" And The Pipeline Name Is "<Pipeline_Name>". I Would Like To Retrieve The Version Of This Pipeline. I Tried Using