Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Is It Possible To Add Extra Arguments To

is it possible to add extra arguments to pip install for a docker agent? somewhere in clearml.conf or maybe some docker arguments?
I'm trying to add a trusted host to pip install so I guess I need to execute pip install yyy --trusted-host xxx . My requirements.txt file has the extra index and the trusted host but I get this error
Usage: /root/.clearml/venvs-builds/3.8/bin/python -m pip install [options] <requirement specifier> [package-index-options] ... /root/.clearml/venvs-builds/3.8/bin/python -m pip install [options] -r <requirements file> [package-index-options] ... /root/.clearml/venvs-builds/3.8/bin/python -m pip install [options] [-e] <vcs project url> ... /root/.clearml/venvs-builds/3.8/bin/python -m pip install [options] [-e] <local project path> ... /root/.clearml/venvs-builds/3.8/bin/python -m pip install [options] <archive url/path> ... no such option: --trusted-host xxx RequirementsManager handler <clearml_agent.helper.package.external_req.ExternalRequirements object at 0x7f40c0fe9130> raised exception: Failed installing GIT/HTTPs package '--trusted-host xxx' clearml_agent: ERROR: Could not install task requirements! Failed installing GIT/HTTPs package '--trusted-host xxx'

  
  
Posted one year ago
Votes Newest

Answers 8


SuccessfulKoala55 I can't get it to work... I tried using the pip conf locally and it works, but the agent doesn't seem to be able to install the package

  
  
Posted one year ago

The package on my index is called data-service-client , see the log below:
Looking in indexes: , WARNING: The repository located at unicorn is not a trusted or secure host and is being ignored. If this repository is available via HTTPS we recommend you use HTTPS instead, otherwise you may silence this warning and allow it anyway with '--trusted-host unicorn'. ERROR: Could not find a version that satisfies the requirement data-service-client==1.0.0 (from -r /tmp/cached-reqs1h8bd_gt.txt (line 2)) (from versions: none) ERROR: No matching distribution found for data-service-client==1.0.0 (from -r /tmp/cached-reqs1h8bd_gt.txt (line 2)) clearml_agent: ERROR: Could not install task requirements! Command '['/root/.clearml/venvs-builds/3.8/bin/python', '-m', 'pip', '--disable-pip-version-check', 'install', '-r', '/tmp/cached-reqs1h8bd_gt.txt', '--extra-index-url', ' ']' returned non-zero exit status 1.

  
  
Posted one year ago

I think the issue is that the host is not trusted... it looks like it looks into the index

  
  
Posted one year ago

hiya Jake, how do I inject this with the extra_docker_shell_script setting?

  
  
Posted one year ago

You can add it there as well, depends on where you need to use it

  
  
Posted one year ago

do I need to set the extra_index_url in clearml.conf as well?

  
  
Posted one year ago

Hi ElegantCoyote26 , you can add this in the default ~/.pip/pip.conf file (see https://stackoverflow.com/questions/59287824/specifying-multiple-trusted-hosts-in-pip-conf ). This can be easily injected into the docker container using the extra_docker_shell_script setting for the agent

  
  
Posted one year ago

Something like:
agent.extra_docker_shell_script = [ "echo \"[global]\" >> /root/.pip/pip.conf", "echo \"trusted-host = hostname.com\" >> /root/.pip/pip.conf" ]

  
  
Posted one year ago