I've tried to run something like clearml-task ... --docker_bash_setup_script "cd $(echo /root/.clearml/venvs-builds/${PYTHON_VERSION%.*}/task_repository/...) && pip install ." but it not working because the repo is fetching after docker_bash_setup_script, so I need to run this command later

can’t find the desired method, I thought that tasks.get_configurations is exactly what I need, but it is not

so we may use more specific lib/tool or just add a if-statement for case “ssh:git@”

/opt/clearml/logs/apiserver.log:

AgitatedDove14 sorry, no, in fact my configuration looks like:

` ...

agent.git_user=""
agent.git_pass=""
agent.git_host=""

agent.package_manager.extra_index_url= [

]

agent {
worker_id: ""
worker_name: ""
force_git_ssh_protocol: true

... `

no, other

I think docker mode is what you need to use if you want to pre-install packages in an environment

In order to use newest version I have to install the library at every run. I don’t think that building a docker image at every run is a good solution here. So the only solution is add it pythonically.

python:3.7.13-bullseye

when I restart the agent, it works fine, but on the second launch docker does not mount the ssh keys folder:
'-v', '/tmp/clearml_agent.ssh.rbw8o0t7:/root/.ssh',I don’t understand why. AgitatedDove14 JitteryCoyote63 could you explain the logic behind that? CLEARML_AGENT_DISABLE_SSH_MOUNT variable is not set.

So it fails with this log message:
` ...
Using cached repository in "/root/.clearml/vcs-cache/<MY_REPO>.git.893c8c47c9813c27eb1fe8d0aeb77a11/<MY_REPO>.git"
fatal: Could not read f...

ContemplativeGoat37 hi, any updates? I have a similar issue due executing clearml-data create command, also the status is stuck in “uploading”

And when I’m trying to add a file to dataset, this happens:
` Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f20d7231430>: Failed to establish a new connection: [Errno 111] Connection refused')': /
Retrying (Retry(total=1, conn...

I’ve found the answer:
https://github.com/allegroai/clearml-agent/issues/42#issuecomment-887331420

AgitatedDove14 , do you know the answer?

CostlyOstrich36 it is ok if I use agent in docker mode, but what should I use in other cases?

this is the case of developing AutoML: when I have a lot of datasets and the model should be nice at all datasets in average. So projects here are different versions of AutoML and I need to compare them

I want aggregate only final metrics from the model. For example, "Metric HO" (holdout) here:

CostlyOstrich36 I’m running the task that doesn’t need GPU by this command
clearml-task … --docker python:3.7.13-bullseye

@<1523701070390366208:profile|CostlyOstrich36> I need to compare aggregated values: I want to compare mean metric value of N experiments from project 1 vs mean metric value of N experiments from project 2

task log
` task ca3ab0ce39aa436f9e656fff378a2c25 pulled from c39519fcfb3f4353808fd266d6100795 by worker v012-0:gpuGPU-0929fd0f-eff1-91f1-854e-9874599660c3
2022-12-12 16:32:21
Current configuration (clearml_agent v1.5.1, location: /tmp/.clearml_agent.guezjnez.cfg):

api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retri...

Hi CostlyOstrich36

How are you mounting the credentials?
Is this also mounted into the docker itself?

as I wrote above, it is mounted automatically:
'-v', '/tmp/clearml_agent.ssh.kqzj9sky:/root/.ssh

What version of

ClearML-Agent

are you using?

1.3.0