ClearML FAQ | I'Ve Been Using Add_Function_Step In The Pipeline Controller As Of Yet. Now I Wish To Use Add_Step For One Of The Steps And Pass In A Task Id. Only Problem Is, For Some Of The Argparse Parameters, I Want To Modify The Values In The New Task. Can You Guys

Answered

I'Ve Been Using Add_Function_Step In The Pipeline Controller As Of Yet. Now I Wish To Use Add_Step For One Of The Steps And Pass In A Task Id. Only Problem Is, For Some Of The Argparse Parameters, I Want To Modify The Values In The New Task. Can You Guys

I've been using add_function_step in the Pipeline Controller as of yet. Now I wish to use add_step for one of the steps and pass in a Task ID. Only problem is, for some of the argparse parameters, I want to modify the values in the new task. Can you guys guide me for it?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					VexedCat68
				
					0
					 × 1

Votes Newest

Answers 3

Sorry for the late reply. The situation is that when I ran the task initially, it took arguments in using ArgParse. It took in a lot of arguments. Now my understanding is that add_step() clones that task. I want that to happen but I would like to be able to modify some of the values of the args, e.g epochs or some other argument.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					VexedCat68
				
					0
					 × 1

You mean you want the new task created by add_step to take in certain parameters? Provided where/by who?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Alright I solved it. Given that my parameters are stored inside args. the way to do it would be,

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					VexedCat68
				
					0
					 × 1

Write your answer

1K Views

3 Answers

2 years ago

one year ago

Tags

Similar posts

Hello! I Have A Clearml-Task That Reads Args From Command Line Using Argparse. Before This Worked Fine. Now, Args Are Show Up In The Configuration Tab Of The Experiment, But Are Not Being Passed To The Script, Printing Passed Argyments Yields An Empty Lis

Hi Everyone! First Of All, Huge Thanks To The Clearml Team For This Wonderful Tool. I Wish I Knew It Earlier To Use It For My Ml/Dl Projects! I'Ve A Question Regarding The

Hello, Ive Been Reading The Docs Of Hyperparameteroptimizer, And Various Questions In The Channel, But Couldn'T Find An Answer. I Have A Working Hpo Run, But Many Times Experiments Fail , For Uncontrollable Reasons. Is There A Way To Tell The Optimizer To

Hi All, Idk Whether This Is The Right Channel To Ask This Question My Team Are Using Clearml As Part Of Our Development Process. We Wish To Use Clearml-Serve As Well To Deploy Our Services To K8S; However, As Clearml-Serve Is Not Mature Enough, We’Ll Wai

In The Configuration Section Of An Experiment, I Can See The Args I Passed Via Argparse. Is There Any Way To Create Other Sections Other Than Args And Tf_Define

Hi, How Might I Use The Sdk To Pull Parameters Of The Agent'S Clearml.Conf Into My Code During Runtime? For Example, If I Wish To Pull The Configuration For Aws.S3.Credentials.Key And Aws.S3.Credentials.Secret?

I Got An Interesting Question From My Devs. If They Wish To Do Distributed Training, Is Clearml K8S Glue Suitable For It? Local Multiple Gpu: Just A Matter Of Assigning More Than One Gpu In The Yaml File Sent To The K8S Glue. Question Is How To Make This

Hi Again. As I Am Running My Experiment From Server Using Agent, I Am Failing On The Point, Where The Arguments Of Argparse Are Processed. When Is The Agent Task Registered. I Am Getting None For Task.Current_Task() At The Begining Of My Script.

I Have A Second Question As Well, Is It Possible To Disable Any Parts Of The Automagical Logging? In My Project I Use Both Config And Argparse. It Works By Giving Path To A Config File As A Console Argument And Then Allow The User To Adjust Values With Mo