Hi, I'M Trying To Run My Code With A Pipelinecontroller Within A Docker Container Instead Of On My Local Computer. Currently Having Trouble Where The Code Doesn'T Run In The Repo As Expected; "No Repository Found, Storing Script Code Instead" Is The Warni

Answered

Hi, I'm trying to run my code with a PipelineController within a docker container instead of on my local computer. Currently having trouble where the code doesn't run in the repo as expected; "no repository found, storing script code instead" is the warning. Using set_repo to the github also presents a problem where I'm running a script in a folder in the repo, but the execution work directory is the root and not the intended folder. Any suggestions as to how to fix this? Is this a problem with the clearml.conf file? Or is there a way to change the execution work directory for the pipeline controller?

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					BitingDeer35
				
					0
					 × 1

Votes Newest

Answers

Hi @<1633638724258500608:profile|BitingDeer35> ! Looks like the SDK doesn't currently allow to create steps/controllers with a designated cwd. You will need to call the set_script function on your step's tasks and on the controller for now.
For the controller: If you are using the PipelineDecorator, you can do something like: PipelineDecorator._singleton._task.set_script(working_dir="something") , before you are running the pipeline function. In the case of regular PipelineController s , you need to do something like controller._task.set_script("...") .
For steps: you need to iterate through each node and change the cwd before the nodes run:

for node in controller.nodes:
   node.job.task.set_script("...")

  				
Posted 
	9 months ago

					More
				  		
  Report
		
					SmugDolphin23
				
					0

Write your answer

857 Views

1 Answer

9 months ago