Hi Guys ! I Am Using My Agent In Docker Mode (Everything Prepared For Experiments). I Am Facing Following Challenge. In My Code:

Answered

Hi guys ! i am using my agent in docker mode (everything prepared for experiments). I am facing following challenge. In my code:

import textwrap

from clearml import Task

task = Task.create(
    task_name='YYYYY',
    project_name='YYYYY',
    repo='YYYYY',
    branch='YYYYY',
    script='YYYYY.py',
    commit='',
    docker='YYYYY:latest',
    docker_args='--network=host',
    requirements_file=''
    )

However, after i run this task from dashboard it will still look for reuqirements.txt in repository. Is there any way how to ignore / skip this step ?

  				
Posted 
	2 years ago

					More  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Votes Newest

Answers 9

Hi ExasperatedCrocodile76 , I assume you run this code locally, and than try to enqueue the created task from the UI into a queue serviced by an agent? If so, can you attach the log for the task that failed?

  				
Posted 
	2 years ago

					More  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

The agent simply try to install requirements from requirements.txt , however i dont want to do that because i have my docker image ready.

  				
Posted 
	2 years ago

					More  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

I understand what you mean. I am just describing different case. Lets assume i have my docker image already (all dependencies , data solved). Right now I run my task and it automatically looks for requirements.txt file in the repository. My question is -> is there any way to avoid this (simplest solution for now will be to -> rename requirements.txt to different filename)? I tried the things you sent already. The thing is that in requirements.txt in this repos can not be installed that easily and i would like to avoid it , because i have everything ready in the image.

  				
Posted 
	2 years ago

					More  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

ExasperatedCrocodile76 , I think you need to set agent.package_manager.system_site_packages: True
In clearml.conf

ClearML doesn't assume that you have all the necessary packages installed so it does need to have some sort of basis for the packages to install

  				
Posted 
	2 years ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Might be good idea to specify the python binary as well. You should go over the various configurations here:
None

  				
Posted 
	2 years ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

ExasperatedCrocodile76 sorry for the delay. can you attach the screenshot of the task execution details from the UI (the INSTALLED PACKAGES section)?

  				
Posted 
	2 years ago

					More  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

ExasperatedCrocodile76 it would help if you could attach the task log

  				
Posted 
	2 years ago

					More  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Also a good read are the environment variables - I think those also allow you some advanced capabilities
None

  				
Posted 
	2 years ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Line 393.

  				
Posted 
	2 years ago

					More  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Write your answer

1K Views

9 Answers

2 years ago