Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey! I Have A Specific Use Case For Installing Packages And Can'T Seem To Get It To Work Properly. The Problem Is That I Need To Install One Package From A Local Nexus Repository. This Repository Is, Of Course, Protected By A Username And Password. As I W

Hey!
I have a specific use case for installing packages and can't seem to get it to work properly. The problem is that I need to install one package from a local Nexus repository. This repository is, of course, protected by a username and password. As I work for a company, I cannot use the extra index URL from Pip described here ( None ), as Pip does not favour any index. This means that if a library with the same name is published on PyPI, there is a chance that we will download the wrong one. As a workaround, I copied the complete link to the package in the requirements file (https://${USER}:${PASSWORD}@nexus..../package.whl). The first time I call 'execute remotely', this works fine, the environment variables are read out, and the package is installed. However, when I copy the task and enqueue it, it fails as it installs PIP (package @ None ) rather than the original PIP from the requirements.txt. I tried the set_packages() function, which had no effect on remote agents, and the Task.force_requirements_env_freeze() function, which also did not work. Is there a way to use Nexus for this package only without installing it in the Docker image that the agents use? Thanks in advance.

  
  
Posted 4 months ago
Votes Newest

Answers 8


Hi @<1717350310768283648:profile|SplendidFlamingo62> , you could also add it as a bash init script inside the container. Basically run a bash script to manually install it or import it in whatever fashion you do so manually today.

WDYT?

  
  
Posted 4 months ago

Ah sorry. I use pip install -r requirements.txt. I have the environment variables also set.

  
  
Posted 4 months ago

I mean when you manually setup your environment, how do you install those packages?

  
  
Posted 4 months ago

Hi @<1523701070390366208:profile|CostlyOstrich36> , thanks for the anwer. This would work but then I would only have one "global" version of the lib and could not install in Task1 lib==1.0 and in Task2 lib==2.0 or?

  
  
Posted 4 months ago

How do you currently install from your 'internal' repo?

  
  
Posted 4 months ago

I think then you can use Task.add_requirements - None

And inject any relevant env variables into the container

  
  
Posted 4 months ago

We let clearml track the repository and have the login data in the agent configuration.

  
  
Posted 4 months ago

Thank you for your idea. Unfortunately, it does not work. The package will be tracked locally correctly, but when the agent runs this for the first time, it will overwrite the original PIP with PIP (Package @ Nexus). When I clone this task and enqueue it, it will fail because the username and password are no longer in the Nexus link.

  
  
Posted 4 months ago
602 Views
8 Answers
4 months ago
4 months ago
Tags
Similar posts