ClearML FAQ | Hi All, What Is The Appropriate Way To Mount A Volume When Running The Docker Container For A Task? I'M Executing A Task From The Experiment Manager And Adding In

Answered

Hi All, What Is The Appropriate Way To Mount A Volume When Running The Docker Container For A Task? I'M Executing A Task From The Experiment Manager And Adding In

Hi all, what is the appropriate way to mount a volume when running the docker container for a task? I'm executing a task from the experiment manager and adding in v /tmp/.X11-unix:/tmp/.X11-unix:rw to the container args in the experiment tracker from the UI, however the clearml-agent (running in k8s cluster) gives me an error message of

skipping docker argument -v (only -e --env supported)
skipping docker argument /tmp/.X11-unix:/tmp/.X11-unix:rw (only -e --env supported)

is the mounting of volumes local to the instance supported?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NaughtyFish36
				
					0
					 × 1

Votes Newest

Answers 2

Solved this but going to leave it up in case it's useful to anyone - just used the pod template in the values.yml for the clearml-agent helm chart to mount the hostpath as a volume mount i.e.:

    podTemplate:
    # -- volumes definition for pods spawned to consume ClearML Task (example in values.yaml comments)
    volumes:
      - name: x11-host-dir
        hostPath:
          path: /tmp/.X11-unix 
    volumeMounts:
      - name: x11-host-dir
        mountPath: '/tmp/.X11-unix'

  				
Posted 
	one year ago

					More
				  		
  Report
		
					NaughtyFish36
				
					0
					 × 1

Nice! Well found and thanks for posting the solution!

May I ask out of curiosity, why mount X11? Are you planning to use a GUI app on the k8s cluster?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrab78
				
					0
					 × 1

Write your answer

1K Views

2 Answers

one year ago

one year ago

Tags

Similar posts

Hi All. I'M Trying To Start Docker Container In Agent Not As A Root. Read, That There Is Clearml_Agent_Exec_User Environment Variable For That. But Is Seems To Be Ignored, When I Pass It As With Docker'S -E Argument. What'S The Correct Way To Make Agent N

What The Best Practice To Configure Clearml-Agent In The Way To Don’T Install Packages That Are Already Available Every Time? I Use Nvidia-Docker To Run The Train Script For Example. I Initialized Clearml-Agent Inside A Running Nvidia-Docker Container

Hey There, I Am Trying To Use A Local Docker Agent, But I Cannot Run Tasks There. Using The Bare Metal Variant With Venvs Works Fine. It Seems As The Process Cannot Proceed After Installing Clearml-Agent On The Docker Container, Because The Experiment Is

Help Please. I Have My Clearml Server Running In A Docker Container. Now, I Am Training My Ml Models In Another Docker Container. I Want To Track These Models With My Clearml Server Located In The First Container. What Configuration Do I Need To Do?

Help Please. I Have My Clearml Server Running In A Docker Container. Now, I Am Training My Ml Models In Another Docker Container. I Want To Track These Models With My Clearml Server Located In The First Container. What Configuration Do I Need To Do?

Hi, I'M Trying To Run My Code With A Pipelinecontroller Within A Docker Container Instead Of On My Local Computer. Currently Having Trouble Where The Code Doesn'T Run In The Repo As Expected; "No Repository Found, Storing Script Code Instead" Is The Warni

Hi Everyone! I'M Having A Trouble With Executing Tasks Remotely From Web Ui Using Clearml Agent Docker Mode. (With Self-Hosted Server On Windows Computer) I Enqueued A Training Task From Web Ui, And The Docker Container Is Always "Running", But The Acutal

Hello, I'M Confused About The Best Way To Use A Docker Container To Manage The Environment For Experiments. I'Ve Gone Through Some Of The Tutorials Running In Venv Mode And Am Now Trying To Run Some Of My Own Codebase. I Have A Docker Container With All T

Hi I Have An Issue With The Clearml-Agent In Docker Mode. I Am Trying To Mount Additional Stuff In The Container Via Sur Default Via The Agent.Default_Docker.Arguments - Namely The Docker Socket. I See

Hi Everyone, Is There An Option To Not Mount Cache Into The Docker Of An Clearml-Agent? E.G. Datasets Are Downloaded Into The Docker And Gone When The Docker Container Is Removed By The Agent.