Hi Guys ! I Am Using My Agent In Docker Mode (Everything Prepared For Experiments). I Am Facing Following Challenge. In My Code:

Answered

Hi guys ! i am using my agent in docker mode (everything prepared for experiments). I am facing following challenge. In my code:

import textwrap

from clearml import Task

task = Task.create(
    task_name='YYYYY',
    project_name='YYYYY',
    repo='YYYYY',
    branch='YYYYY',
    script='YYYYY.py',
    commit='',
    docker='YYYYY:latest',
    docker_args='--network=host',
    requirements_file=''
    )

However, after i run this task from dashboard it will still look for reuqirements.txt in repository. Is there any way how to ignore / skip this step ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Votes Newest

Answers 9

Hi @<1523701181375844352:profile|ExasperatedCrocodile76> , I assume you run this code locally, and than try to enqueue the created task from the UI into a queue serviced by an agent? If so, can you attach the log for the task that failed?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

@<1523701181375844352:profile|ExasperatedCrocodile76> sorry for the delay. can you attach the screenshot of the task execution details from the UI (the INSTALLED PACKAGES section)?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Might be good idea to specify the python binary as well. You should go over the various configurations here:
None

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

The agent simply try to install requirements from requirements.txt , however i dont want to do that because i have my docker image ready.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Line 393.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

Also a good read are the environment variables - I think those also allow you some advanced capabilities
None

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

@<1523701181375844352:profile|ExasperatedCrocodile76> it would help if you could attach the task log

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

I understand what you mean. I am just describing different case. Lets assume i have my docker image already (all dependencies , data solved). Right now I run my task and it automatically looks for requirements.txt file in the repository. My question is -> is there any way to avoid this (simplest solution for now will be to -> rename requirements.txt to different filename)? I tried the things you sent already. The thing is that in requirements.txt in this repos can not be installed that easily and i would like to avoid it , because i have everything ready in the image.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ExasperatedCrocodile76
				
					0
					 × 1

@<1523701181375844352:profile|ExasperatedCrocodile76> , I think you need to set agent.package_manager.system_site_packages: True
In clearml.conf

ClearML doesn't assume that you have all the necessary packages installed so it does need to have some sort of basis for the packages to install

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

556 Views

9 Answers

one year ago