Hi All! I’M Trying To Set Up Remote-Launching Of Training Scripts On Clearml Autoscaler, And I Can’T Figure Out One Thing: How To Make Remote Clearml Agent Do

Answered

Hi all! I’m trying to set up remote-launching of training scripts on ClearML autoscaler, and I can’t figure out one thing: how to make remote ClearML agent do pip install -e . before launching the script? I can see from the logs it installs the package requirements in the venv, but I also need to install the package containing the training script itself. Any tips?

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					SuccessfulPuppy43
				
					0
					 × 1

Votes Newest

Answers 2

In my case I need it, because the setup also builds some wheels. Adding -e . to requirements works!

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					SuccessfulPuppy43
				
					0
					 × 1

Hi @<1716987933514272768:profile|SuccessfulPuppy43>

How to make remote ClearML agent do

pip install -e .

in theory there is no need to do that clearml-agent adds the repo root folder to the python path.
If you insist on actually installing it, try to add to your "installed packages" section a "requirement.txt" compatible line:

-e .

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Write your answer

552 Views

2 Answers

6 months ago