ClearML FAQ | Hi Everyone! I'M Trying To Make Use Of Remote Execution In Clearml, But I Keep Getting An Error After The Agent Clones The Repo On The Remote Machine:

Answered

Hi Everyone! I'M Trying To Make Use Of Remote Execution In Clearml, But I Keep Getting An Error After The Agent Clones The Repo On The Remote Machine:

Hi everyone!
I'm trying to make use of remote execution in ClearML, but I keep getting an error after the agent clones the repo on the remote machine:

clearml_agent: ERROR: [Errno 36] File name too long: '/home/user/.clearml/venvs-builds/3.9/task_repository/repo.git/-m torch_ml.....fetch_and_train  --model-subtype ...'

It seems like the agent is trying to use part of the command I use to start the training as the file name, but this is failing as the command is long. Is there any way around this other than shortening the command? Happy to provide more info if needed, thanks!

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					MysteriousParrot48
				
					0
					 × 1

Votes Newest

Answers 3

Hi @<1625666182751195136:profile|MysteriousParrot48> , how did you run the original experiment? Can you add the full log and also the agent configuration?

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

@<1523701070390366208:profile|CostlyOstrich36> Here is the task log and agent configuration

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					MysteriousParrot48
				
					0
					 × 1

Hi John, this is for a new experiment but I'm running it by creating a new task in ClearML clearml.task.Task.init(...) and then calling task.execute_remotely(queue_name=...) . My goal is to run the same command I enter on a clearML agent instead of locally, but I can see in a lot of the documentation a pre-existing task is being cloned then queued - does remote execution work with new tasks as well? Give me a second to remove credentials etc from the logs/agent config and I'll send it over, thanks.

  				
Posted 
	6 months ago

					More
				  		
  Report
		
					MysteriousParrot48
				
					0
					 × 1

Write your answer

437 Views

3 Answers

6 months ago

6 months ago

Tags

Similar posts

Hi There, I Am Looking For A Way To Use The Hyperparameter Optimization Tool From Clear Ml, For Different Algorithms I Build. The Idea Is, That I Can Use A Command Line To Specify Which Algorithm I Want To Optimize, And Let Clear Ml Do The Rest. The Issue

Hello Everyone! I'M Using Clearml, Yolo V8 And Clearml Gpu Compute (For Orchestration). The Issue Is That I Can'T Find A Compatibility To Use Gpu During Yolo Training (On A Remote Instance, Not Local). My Local Machine Is Macbook On M2 Chip - Maybe It'S

Hello, I'M Trying To Use The Agent To Orchestrate Tasks - Our Install Is Quite Complicated And I'Ve Wrapped It All Up With The Code In A Docker Container; Is There A Way To Get The Agent To Just Run A Command In The Container Rather Than Try To Build/Inst

Hi All! I’M Currently Working On A Project Where I’M Making Use Of Clearml For Hyperparameter Tuning. In My Workflow, I Have A Python Script That I Usually Run With The Following Command:

Hi Everyone, I'M New To Clearml And I Want To Run A Task On A Remote Host Inside A Docker Container. The Python Interpreter I Need To Use Is Located At

Need Help ! I Am Able To Train Models From Our Local Machines And Log Everything On The Clearml Server Without Any Issues, The Same Training Gets Stuck When I Use Remote Training. The Logs Do Not Provide Any Useful Information, And The Last Line In The L

Hi, I Have A Remote Task That I Want To Run On Some Of The Gpus Of The Remote Machine. I Set The Agent In The Remote Machine On Two Of The Gpus. How Do I Query The Agent What Are His Gpu So That My Code Will Use Only Them

I Am Using Hydra. When Running Locally The Code Takes Into Consideration Any Hydra Override Arguments I Pass In The Command Line. But When I Run The Same Task In Remote (Using Clearml-Agent).... It Uses Only The Default Values. Is This Behaviour Reasonab

When I Run My Tasks On The Remote Machine It Runs Successfully. However When My Colleague Tries To Run His Task On The Same Remote Machine It Fails To Access Git ("Clearml_Agent: Error: Failed Cloning Repository."). I Think That We Both Use Different Auth

Hi Everyone How Can I Pass Manual Input During Git Action When The Command I Use Asking Me To Input Clearml Configuration. I'M Running 'Clearml-Init' Command On Git Action, How To Put The Configuration When It Ask For "Paste Copied Configuration Here: ",