Hello! I Am New To Clearml And Trying To Set It Up For My Org, And Have A Question Regarding Git Repository. So From What I Understood, Clearml Agent Spins Up A Docker Container And Then Clone The Github Repository, My Problem Is It Is Taking Too Long As

Answered

Hello! I am new to clearML and trying to set it up for my org, and have a question regarding git repository.
So from what I understood, clearml agent spins up a docker container and then clone the github repository, my problem is it is taking too long as my organization uses mono repo. I thought about trying to do sparse checkout instead but I could not find any place in the clearml.conf file to edit to add this behavior. Any thoughts on how to do it would be greatly appreciated, thank you!

  				
Posted 
	2 months ago

					More  		
  Report
		
					RipeSeaanemone60
				
					0
					 × 1

Votes Newest

Answers 3

got it, will do thanks!

  				
Posted 
	2 months ago

					More  		
  Report
		
					RipeSeaanemone60
				
					0
					 × 1

Hi RipeSeaanemone60 , I think the sparse flag isn't supported currently. I'd suggest opening a GitHub feature request for this 🙂

  				
Posted 
	2 months ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

For now, I found that I can use CLEARML_AGENT_FORCE_CODE_DIR, but I have two questions:

First I was passing this through the extra docker arguments in Task UI, but is there a way to pass this flag through agent config? clearml.conf.

Second, I noticed that if I use this flag, it do not apply uncommitted changes, is there a way to do that and to switch to the proper commit?

  				
Posted 
	2 months ago

					More  		
  Report
		
					RipeSeaanemone60
				
					0
					 × 1

Write your answer

239 Views

3 Answers

2 months ago