ClearML FAQ | Hi All, What Is The Appropriate Way To Mount A Volume When Running The Docker Container For A Task? I'M Executing A Task From The Experiment Manager And Adding In

Answered

Hi All, What Is The Appropriate Way To Mount A Volume When Running The Docker Container For A Task? I'M Executing A Task From The Experiment Manager And Adding In

Hi all, what is the appropriate way to mount a volume when running the docker container for a task? I'm executing a task from the experiment manager and adding in v /tmp/.X11-unix:/tmp/.X11-unix:rw to the container args in the experiment tracker from the UI, however the clearml-agent (running in k8s cluster) gives me an error message of

skipping docker argument -v (only -e --env supported)
skipping docker argument /tmp/.X11-unix:/tmp/.X11-unix:rw (only -e --env supported)

is the mounting of volumes local to the instance supported?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NaughtyFish36
				
					0
					 × 1

Votes Newest

Answers 2

Nice! Well found and thanks for posting the solution!

May I ask out of curiosity, why mount X11? Are you planning to use a GUI app on the k8s cluster?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrab78
				
					0
					 × 1

Solved this but going to leave it up in case it's useful to anyone - just used the pod template in the values.yml for the clearml-agent helm chart to mount the hostpath as a volume mount i.e.:

    podTemplate:
    # -- volumes definition for pods spawned to consume ClearML Task (example in values.yaml comments)
    volumes:
      - name: x11-host-dir
        hostPath:
          path: /tmp/.X11-unix 
    volumeMounts:
      - name: x11-host-dir
        mountPath: '/tmp/.X11-unix'

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NaughtyFish36
				
					0
					 × 1

Write your answer

1K Views

2 Answers

one year ago

one year ago

Tags

Similar posts

Hi Everyone Can Clearml Session Be Somehow Saved, If The Host Machine For Docker Container, Where Agents Are Running, Was Rebooted?

Hi All. I'M Trying To Start Docker Container In Agent Not As A Root. Read, That There Is Clearml_Agent_Exec_User Environment Variable For That. But Is Seems To Be Ignored, When I Pass It As With Docker'S -E Argument. What'S The Correct Way To Make Agent N

What The Best Practice To Configure Clearml-Agent In The Way To Don’T Install Packages That Are Already Available Every Time? I Use Nvidia-Docker To Run The Train Script For Example. I Initialized Clearml-Agent Inside A Running Nvidia-Docker Container

Hey There, I Am Trying To Use A Local Docker Agent, But I Cannot Run Tasks There. Using The Bare Metal Variant With Venvs Works Fine. It Seems As The Process Cannot Proceed After Installing Clearml-Agent On The Docker Container, Because The Experiment Is

Help Please. I Have My Clearml Server Running In A Docker Container. Now, I Am Training My Ml Models In Another Docker Container. I Want To Track These Models With My Clearml Server Located In The First Container. What Configuration Do I Need To Do?

Help Please. I Have My Clearml Server Running In A Docker Container. Now, I Am Training My Ml Models In Another Docker Container. I Want To Track These Models With My Clearml Server Located In The First Container. What Configuration Do I Need To Do?

Hi, I'M Trying To Run My Code With A Pipelinecontroller Within A Docker Container Instead Of On My Local Computer. Currently Having Trouble Where The Code Doesn'T Run In The Repo As Expected; "No Repository Found, Storing Script Code Instead" Is The Warni

Hi Everyone! I'M Having A Trouble With Executing Tasks Remotely From Web Ui Using Clearml Agent Docker Mode. (With Self-Hosted Server On Windows Computer) I Enqueued A Training Task From Web Ui, And The Docker Container Is Always "Running", But The Acutal

Hello, I'M Confused About The Best Way To Use A Docker Container To Manage The Environment For Experiments. I'Ve Gone Through Some Of The Tutorials Running In Venv Mode And Am Now Trying To Run Some Of My Own Codebase. I Have A Docker Container With All T

Hi I Have An Issue With The Clearml-Agent In Docker Mode. I Am Trying To Mount Additional Stuff In The Container Via Sur Default Via The Agent.Default_Docker.Arguments - Namely The Docker Socket. I See