ClearML FAQ | Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Answered

Hello Clearml Community! I Have A Question Regarding Batch Inference Using A Base Docker Image In Clearml. I Have A Docker Image That Is Configured With The Necessary Environment And Code For The Task At Hand. My Goal Is To Generate And Enqueue A Task Uti

Hello ClearML community!
I have a question regarding batch inference using a base Docker image in ClearML. I have a Docker image that is configured with the necessary environment and code for the task at hand. My goal is to generate and enqueue a task utilizing this base image. However, it appears challenging to accomplish this without configuring the SOURCE CODE section (such as a git repository). I would like to avoid inspecting INSTALLED PACKAGES, as it is unnecessary for my prepared Docker container and seems to impede the task's startup speed.
Is there a way to achieve my inference task solely by utilizing the base image?
I appreciate your help in advance!

  				
Posted 
	one year ago

					More  		
  Report
		
					CostlyElephant1
				
					0
					 × 1

Votes Newest

Answers 4

Thanks for the fast reply! I will look into it.

  				
Posted 
	one year ago

					More  		
  Report
		
					CostlyElephant1
				
					0
					 × 1

Hi again CostlyOstrich36
One further question. Is it possible also to avoid using a git project ? (given that the code could be already present inside the docker container).
hat would be the benefits of setting it in the clearml task config instead? thanks again!

  				
Posted 
	one year ago

					More  		
  Report
		
					CostlyElephant1
				
					0
					 × 1

I don't think there is such a capability, but please open a GitHub feature request, I think it would be a cool feature!

  				
Posted 
	one year ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Hi CostlyElephant1 , I think this is what you're looking for:
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
None

  				
Posted 
	one year ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

1K Views

4 Answers

one year ago

one year ago

Tags

Similar posts

Hi. I Want To Run Clearml-Agent Inside A Docker Container. With The Default Image In My Clearml.Conf File, It Is "Image: "Nvidia/Cuda:11.0.3-Cudnn8-Runtime-Ubuntu20.04", How Do I Run The Agent In Docker Mode And See The Worker Running In The Clearml Ui

Hello! I Would Like To Use My Own Docker Image For A Clearml Task Pod. My Docker Registry Is Aws Ecr With Authentication. For A Regular Deployment, I Use A Secret Added To The Deployment As Follows:

Hi, I Have A Question: How Can I Set Docker Image When Init A Clearml Task, I Don'T See Docker Option In Task.Init. I Saw A Docker Option In Task.Create But When I Create A Task With Task.Create And Docker Option => Task Couldn'T Run On Remote Agent.

Hi Everyone, I Am New To Clearml And Am Trying To Use Clearml Agent With A Docker Image For Run A Pipeline Remotely. My Agent Is Running And It Is Able To Pick Up The Tasks From The Queue. It Starts Running The Task Inside Docker. However, It Exits The T

Hi There, I Have A Question Regarding The Automatic Requirements Collection Of Clearml-Agent. Currently I Have Two Pip Packages Installed In The Base-Docker Image. When I Run My Experiment I Use:

Hi, I Have A Question About Creation Of Docker Container Using Clearml-Agent, Can I Set A Proxy Then Pulling Image From My Local Docker Hub?

Hello! I’M Currently Using Clearml-Server As An Artifact Manager And Clearml-Serving For Model Inference, With Each Running On Separate Hosts Using Docker Compose. I’Ve Successfully Deployed A Real-Time Inference Model In Clearml-Serving, Configured Withi

Hi Everyone, I'M Running Into A Weird Error When Trying To Clone And Run And Task That Has Completed Successfully. I Have A Test Task That Loads A Dummy Dataset And Trains A Toy Model With Pytorch. When Running Remotely, I Use My Own Docker Image That Has

Hi! I See There'S A New Release Of The Clearml-Agent Package, Is There Any Plan To Update The Allegroai/Clearml-Agent-K8S-Base Docker Image With This Version? In Particular, I Would Like To Use Multiple Queues When Running The Clearml-Agent Chart. I Tried

Hi All, I’M Looking For Suggestions On Best Practices For Easily Going Between Local Development And Remote Execution. Currently, The Approach I’Ve Been Using Is To Have A Gitlab Ci/Cd Pipeline That Builds A New Docker Image For Each Commit And Then Setti