Suppose I Use A Pipeline Decorator To Define A Pipeline:

Answered

suppose I use a pipeline decorator to define a pipeline:
@PipelineDecorator.pipeline(name='my-pipeline', project='my-project', version='0.2') def my_pipeline_function(...)How do I access the value of project within my_pipeline_function ?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					PanickyMoth78
				
					0
					 × 1

Votes Newest

Answers

hi PanickyMoth78
from within your function my_pipeline_function here is how to access the project and task names :

task = Task.current_task()
task_name = task.name
full_project_path = task.get_project_name()
project_name = full_project_path.split('/')[0]

Note that you could also use the full_project_path to get both project and task name
task_name = full_project_name.split('/')[-1]

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SweetBadger76
				
					0
					 × 1

Write your answer

1K Views

1 Answer

2 years ago

one year ago

Hi All, How Can I Have A Global Variable Used In A Pipeline Step? I Have To Define Them In Each Pipeline Step, Otherwise They Are Not Included In The Pipeline Step

Hey, Is There A Way To Set Pipeline Component Return Artifact Compression At A Pipeline Level ? It Would Allow To Make Big Dataframes Flow Across Component Without Having To Resort To Define Temporary Datasets, Currently It'S Generating Only Raw Pickles.

Hi Community! I Have Difficulty Using Clearml Pipeline. I Am Writing The Code Using The Pipeline Decorator, But The Pipeline Does Not Work With The Following Error When Specifying The Docker Image As A Argument Of The Decorator. How Should I Solve It?

Hey There!I’M Trying To Build A Pipeline With The Help Of Decorators. I Have A One-Step Pipeline, And The Step Is Imported From A Different Pipeline, Marked Up With The Component Decorator.

While Running A Pipeline By Decorator, I Am Getting This Error

Hi All! I Write A Data Processing Pipeline. It Is Necessary To Define Many Hyperparameters That Are Inconvenient To Redefine In A Pop-Up Window When Restarting The Pipeline From Ui. Is It Possible To Overrided The Parameters Through The Configuration File

Hi, When Using A Pipeline Decorator How Do I Add A Local Module? I Keep On Getting This Error Message:

Hi All, General Wondering - Suppose I Have A Pipeline That Is Constructed Out Of Several Tasks And One Of The Tasks Fails. I Want My Users To Check Out The Error Message. For That, They Need To Press On The Failed Step And Review The Console. Is There A W

Hey Community!, I Am Trying To Run A Pipeline Using Pipeline Decorator In Two Steps , Now In My First Step I Am Trying To Import A Custom Python File Which Is Already Pushed To My Repository Online, I Am Executing The Pipeline Remotely But Still I Am Gett