ClearML FAQ | Hi All, I Am Trying To Get All Pipeline Tasks Or Task Ids From A Specific Project. The Project In The Details Of One Of The Pipeline Tasks Is Defined As

Answered

Hi All, I Am Trying To Get All Pipeline Tasks Or Task Ids From A Specific Project. The Project In The Details Of One Of The Pipeline Tasks Is Defined As

Hi all, I am trying to get all pipeline tasks or task ids from a specific project. The project in the details of one of the pipeline tasks is defined as "<project_name>/.pipelines/<pipeline_name>" . I get:
Task.query_tasks(project_name="<project_name>/.pipelines/<pipeline_name>") -> []
Task.get_tasks(project_name="<project_name>/.pipelines/<pipeline_name>") -> []
APIClient.client.projects.get_all(name="<project_name>/.pipelines/<pipeline_name>") -> empty Project list
but
Task.query_tasks(task_name="<pipeline_name>") -> list of task ids
Task.get_tasks(task_name="<pipeline_name>") -> list of tasks
APIClient.client.projects.get_all(id=["id of <project_name>/.pipelines/<pipeline_name>"]) -> Project with name="<project_name>/.pipelines/<pipeline_name>"
Why can't I get the tasks of this pipeline project or even the project by name? Are pipelines not handled like projects? Is there a way to get all pipeline tasks in a project?

  				
Posted 
	12 months ago

					More  		
  Report
		
					UnevenSquirrel80
				
					0
					 × 1

Votes Newest

Answers 2

Nice, works! Thank you SmugDolphin23

  				
Posted 
	12 months ago

					More  		
  Report
		
					UnevenSquirrel80
				
					0
					 × 1

Hi UnevenSquirrel80 ! Pipeline projects are hidden. You can try to pass task_filter={"search_hidden": True, "_allow_extra_fields_": True} to the query_tasks function to fetch the tasks from hidden projects

  				
Posted 
	12 months ago

					More  		
  Report
		
					SmugDolphin23
				
					0

Write your answer

779 Views

2 Answers

12 months ago

12 months ago

Tags

Similar posts

How Can I Access Task Ids Of Tasks Running Within A

Hi, I Want To Integrate My Ml Tasks As A Complete Mlops Pipeline. I Am Planning To Create New Tasks By Pulling The Repo From Github. As, Some Of The Models And Utils Packages Are Not Stored In Github, How Can I Use These Packages In My Code To Ensure Tha

Hello Everyone! I Need To Run The Pipeline On Schedule. Are There Any Restrictions On Running Pipelines Through The Scheduler? Would Hidden Project For Pipe Step Tasks Be A Problem For Scheduler?

Hi Everyone, I’D Really Appreciate Your Advice—Thank You In Advance! I’Ve Created A Pipeline Consisting Of Tasks. I Ran Tasks And They Are In Status “Draft”. When I Run The Pipeline Script Using Pipe.Start_Locally(), Everything Works Fine, And The Pipelin

Hi, Does Anyone Know How To Clone Every Step Of A Pipeline To A Project? I'M Doing This To Save All Execution Results And Compare Them With Previous Versions. I Can Achieve This By Running My Pipeline.Py Script, But It Doesn'T Work When I Execute The Same

Hi Everyone! I Am Using Clearml Pipeline For Retraining Purpose, I Just Want To Ask Why Model From Retraining Process Is Stored Under Project "Project_Name/.Pipeline/Pipeline_Name" ? How Do I Make It To Store The Model To "Project_Name" Instead Of "Proje

As Soon As I Refactor My Project Into Multiple Folders, Where On Top-Level I Put My Pipeline File, And Keep My Tasks In A Subfolder, The Clearml Agent Seems To Have Problems:

Hi Guys, I Recently Started Working On Clearml. I Have A Pipeline Which Has Couple Of Tasks Added To It. The Pipeline Executes And Completes As Expected When I Use The Web App. I Am Trying To Start This Pipeline From The Sdk Api. I Have A Two Part Questio

I'M Trying To Read The Runtimes Of Tasks After The Pipeline Finished, For Analytics. Currently, I'M Doing Something Like This:

Hi Everyone, I Noticed A Weird Issue With Pipeline Tasks. I Have A Task In My Project With Configuration That Includes Several Parameters Of Different Types (Strings, Ints, Bools). As Soon As I Use This Task To Create A Pipeline Task Using