Thanks AgitatedDove14 I think the change your suggestion will work if it would mean the client authenticates itself before each time it attempts to run an experiment.

However I have another issue right now, I've manually authenticated on the instance running clearml-agent . We use poetry to install packages for a given project. From the logs, they are installed correctly and a venv is created. But when it comes to running the initial task. It seems that it doesn't use the ...

Thanks for your time looking into this AgitatedDove14 . I've opened a github issue here https://github.com/allegroai/clearml-agent/issues/57

Hi AgitatedDove14 , the versions are:
CLEARML-AGENT version 0.17.2 Poetry version 1.1.5

AgitatedDove14 thanks for responding
The initial experiment ran fine, see "Installed Packages: section looks like:` # Python 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0]

boto3 == 1.17.36
botocore == 1.20.36
clearml == 0.17.5
flake8 == 3.9.0
jmespath == 0.10.0
lxml == 4.6.3
matplotlib == 3.3.4
networkx == 2.5
numpy == 1.19.5
pyflakes == 2.3.1
pymongo == 3.11.3
pytest == 5.4.3
scikit_learn == 0.23.2
scipy == 1.6.1
setuptools == 52.0.0
tensorboard == 2.4.1
torch == 1.6.0+cpu
torch_geome...

My bad, I realised that the Adding venv into cache: /home/ubuntu/.clearml/venvs-builds/3.8 actually adds the entire repository with the venv inside it i.e /home/ubuntu/.clearml/venvs-builds/3.8/task_repository/***.git/.venv . However the the default path that it uses /home/ubuntu/.clearml/venvs-builds/3.8/bin/python is has a venv without all the requried python packages

I'd like to add I changed the in-project = false . And the venvs is still getting in a different place to the one the clearml-agent tries to use when running the experimetn

the poetry.toml looks like this:
[virtualenvs] in-project = trueDo you think this is the issue?

2. 2. I confirm, the venv is created with all packages, when I go to the cached location /home/ubuntu/.clearml/venvs-builds/3.8 and activate it, the packages are there. The full log:
      ` 1617282623837 ip-172-28-11-109:0 INFO task 4ce5aedc75404225b37eda2d9bd9ad8f pulled from 903741980edd416697ca8074f782bdb4 by worker ip-172-28-11-109:0

1617282629221 ip-172-28-11-109:0 DEBUG Current configuration (clearml_agent v0.17.2, location: /tmp/.clearml_agent.xo_7zbpi.cfg):

ag...

Not sure, SuccessfulKoala55 but I think I've run into a bigger problem I realised that the tasks get created without any link to the original repo. So that when I clone a task on clearml-agent it doesn't have all the required packages that I need (including the private ones). Is there a way to detect the repository when initialising a task?

AgitatedDove14
I'm guessing agent is running in venv mode, it was started using clearml-agent daemon --queue default --detached Under installed packages I have " No changes logged ". I have already set the package manager to poetry in the clearml.conf file in the agent section In the execution it installs all the required packages fine and creates the venv, just doesn't use it(I can access the cached venv and when activated, the required packages can be imported)

PS: the experiment I ...