ClearML FAQ | Hi Everyone! I'M Trying To Make Use Of Remote Execution In Clearml, But I Keep Getting An Error After The Agent Clones The Repo On The Remote Machine:

Answered

Hi Everyone! I'M Trying To Make Use Of Remote Execution In Clearml, But I Keep Getting An Error After The Agent Clones The Repo On The Remote Machine:

Hi everyone!
I'm trying to make use of remote execution in ClearML, but I keep getting an error after the agent clones the repo on the remote machine:

clearml_agent: ERROR: [Errno 36] File name too long: '/home/user/.clearml/venvs-builds/3.9/task_repository/repo.git/-m torch_ml.....fetch_and_train  --model-subtype ...'

It seems like the agent is trying to use part of the command I use to start the training as the file name, but this is failing as the command is long. Is there any way around this other than shortening the command? Happy to provide more info if needed, thanks!

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MysteriousParrot48
				
					0
					 × 1

Votes Newest

Answers 3

@<1523701070390366208:profile|CostlyOstrich36> Here is the task log and agent configuration

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MysteriousParrot48
				
					0
					 × 1

Hi John, this is for a new experiment but I'm running it by creating a new task in ClearML clearml.task.Task.init(...) and then calling task.execute_remotely(queue_name=...) . My goal is to run the same command I enter on a clearML agent instead of locally, but I can see in a lot of the documentation a pre-existing task is being cloned then queued - does remote execution work with new tasks as well? Give me a second to remove credentials etc from the logs/agent config and I'll send it over, thanks.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					MysteriousParrot48
				
					0
					 × 1

Hi @<1625666182751195136:profile|MysteriousParrot48> , how did you run the original experiment? Can you add the full log and also the agent configuration?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

965 Views

3 Answers

one year ago

one year ago

Tags

Similar posts

Hi People When I Try To Use Docker Agents They Fail. If I Run The Command Clearml-Agent Daemon --Gpus 0 --Queue Default --Foreground Inside A Docker Prepared With All The Requirements Installed. It Tells Me:

Hi Everyone! Is There A Way To Store Env_Vars Or Secrets In Clearml When We Use Remote Agent To Run The Task? Actually I Have Too Many Envs That Are Confidential.

Hi There, I Am Looking For A Way To Use The Hyperparameter Optimization Tool From Clear Ml, For Different Algorithms I Build. The Idea Is, That I Can Use A Command Line To Specify Which Algorithm I Want To Optimize, And Let Clear Ml Do The Rest. The Issue

Hello Everyone! I'M Using Clearml, Yolo V8 And Clearml Gpu Compute (For Orchestration). The Issue Is That I Can'T Find A Compatibility To Use Gpu During Yolo Training (On A Remote Instance, Not Local). My Local Machine Is Macbook On M2 Chip - Maybe It'S

Hello, I'M Trying To Use The Agent To Orchestrate Tasks - Our Install Is Quite Complicated And I'Ve Wrapped It All Up With The Code In A Docker Container; Is There A Way To Get The Agent To Just Run A Command In The Container Rather Than Try To Build/Inst

Hi All! I’M Currently Working On A Project Where I’M Making Use Of Clearml For Hyperparameter Tuning. In My Workflow, I Have A Python Script That I Usually Run With The Following Command:

Hi Everyone, I'M New To Clearml And I Want To Run A Task On A Remote Host Inside A Docker Container. The Python Interpreter I Need To Use Is Located At

Need Help ! I Am Able To Train Models From Our Local Machines And Log Everything On The Clearml Server Without Any Issues, The Same Training Gets Stuck When I Use Remote Training. The Logs Do Not Provide Any Useful Information, And The Last Line In The L

Hi, I Have A Remote Task That I Want To Run On Some Of The Gpus Of The Remote Machine. I Set The Agent In The Remote Machine On Two Of The Gpus. How Do I Query The Agent What Are His Gpu So That My Code Will Use Only Them

I Am Using Hydra. When Running Locally The Code Takes Into Consideration Any Hydra Override Arguments I Pass In The Command Line. But When I Run The Same Task In Remote (Using Clearml-Agent).... It Uses Only The Default Values. Is This Behaviour Reasonab