Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Team, A Question Around Package Dependencies While Running Hyper-Parameter Tuning. There Is A Version Of Package That I'M Using Which Is Not Available On Pypi, So I'Ve Been Using

Hi team, a question around package dependencies while running hyper-parameter tuning.
There is a version of package that I'm using which is not available on PyPI, so I've been using --find-links to specify where to search for the package. This works fine for running a single task in my local environment. But fails installing this package while running hyper-parameter tuning.

I've also tried to add a requirement file using Task.add_requirements('requirements.txt) In requirements.txt I added --find-links at the top of the file, but this gave me the following parse error
raise InvalidRequirement( pkg_resources.extern.packaging.requirements.InvalidRequirement: Parse error at "'-f https'": Expected W:(0-9A-Za-z)Any input would be appreciated! Thanks!

  
  
Posted 2 years ago
Votes Newest

Answers 11


Hi DefeatedMoth52 , so the reason why we don't support --find-links is that it is not in the requirements.txt standard (Or so I'm told 😄 )
What can be done is just putting the specific links to the wheel (something like https://data.dgl.ai/wheels/dgl-0.1.2-cp35-cp35m-macosx_10_6_x86_64.whl ) in the requirements.txt, and this should work. Makes sense?

  
  
Posted 2 years ago

Makes sense. Thanks!

  
  
Posted 2 years ago

From the successful task it says in the installed package dgl_cu113 == 0.9.0 I assume this is because I manually installed it in my local environment using pip instal -f
However, when trying to run hyperparameter tuning using the same job, it fails to install the package because it's not available via PyPI.

Therefore, I tried to add a requirement.txt file to the task. But that failed parsing with the error included above.

  
  
Posted 2 years ago

CostlyOstrich36 I used it in my local environment to install the package. From ClearML webUI, I can see that the correct version is used for the task.

  
  
Posted 2 years ago

pip install dgl-cu113 -f https://data.dgl.ai/wheels/repo.html

  
  
Posted 2 years ago

How is it shown in the UI?

  
  
Posted 2 years ago

Can you give an example of how you installed it using --find-links (or which command used it)

  
  
Posted 2 years ago

Looking at the source https://github.com/allegroai/clearml-agent/blob/9006c2d28f1fbaa42272473f23d67999cf56ab25/clearml_agent/external/requirements_parser/parser.py#L46 . It seems that this is not support by intention. Is there plan to change this in the future?

  
  
Posted 2 years ago

Hi DefeatedMoth52 , where have you been using --find-links tag? When you run the experiment how does the package show up in the ClearML UI?

  
  
Posted 2 years ago

Maybe AnxiousSeal95 might have some input 🙂

  
  
Posted 2 years ago
1K Views
11 Answers
2 years ago
one year ago
Tags