Hello, I'M Struggling To Get A My Clearml-Agent To Work With Poetry As The Package Manager. When Cloning A Task For Running On The Clearml-Agent, The

Answered

Hello,

I'm struggling to get a my clearml-agent to work with poetry as the package manager.

When cloning a task for running on the clearml-agent, the poetry.lock file is picked up fine from the git repository and all the packages installed correctly into the location: /home/ubuntu/.clearml/venvs-builds.1/3.8/task_repository/repository_name/.venv . (As per clearml-agent logs)

But when running the given task, the virtual environment clearml uses is in /home/ubuntu/.clearml/venvs-builds.1/3.8/bin which doesn't have any of the dependencies in it.

I've ssh'd into the instance running clearml-agent and verified this is indeed the case.

Is this a bug? Any advice would be hugely appreciated

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					SuperficialGrasshopper36
				
					0
					 × 1

Votes Newest

Answers 7

Let me check something

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Hi SuperficialGrasshopper36

/home/ubuntu/.clearml/venvs-builds.1/3.8/task_repository/repository_name/.venv

This is the problem, they should not be installed there, it should be in
/home/ubuntu/.clearml/venvs-builds.1/3.8/
Could you post the poetry.lock file? Maybe it is something there?
What's the poetry version and cleaml-agent versions ?

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Hi AgitatedDove14 , the versions are:
CLEARML-AGENT version 0.17.2 Poetry version 1.1.5

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					SuperficialGrasshopper36
				
					0
					 × 1

Thanks for your time looking into this AgitatedDove14 . I've opened a github issue here https://github.com/allegroai/clearml-agent/issues/57

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					SuperficialGrasshopper36
				
					0
					 × 1

BTW: I suspect this is the main issue:
https://github.com/python-poetry/poetry/issues/2179

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Many thanks!

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Hi SuperficialGrasshopper36
You are diffidently onto a bug 😞
It seems that with the new poetry , we fail to set the target venv (basically it decides for itself), from that point, the execution f the actual code is not running inside the correct venv.
Could you please open a GitHub issue?
I want to make sure this will be addressed 🙂

  				
Posted 
	3 years ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Write your answer

1K Views

7 Answers

3 years ago

one year ago