Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Team, A Question Around Package Dependencies While Running Hyper-Parameter Tuning. There Is A Version Of Package That I'M Using Which Is Not Available On Pypi, So I'Ve Been Using

Hi team, a question around package dependencies while running hyper-parameter tuning.
There is a version of package that I'm using which is not available on PyPI, so I've been using --find-links to specify where to search for the package. This works fine for running a single task in my local environment. But fails installing this package while running hyper-parameter tuning.

I've also tried to add a requirement file using Task.add_requirements('requirements.txt) In requirements.txt I added --find-links at the top of the file, but this gave me the following parse error
raise InvalidRequirement( pkg_resources.extern.packaging.requirements.InvalidRequirement: Parse error at "'-f https'": Expected W:(0-9A-Za-z)Any input would be appreciated! Thanks!

  
  
Posted one year ago
Votes Newest

Answers 11


Hi DefeatedMoth52 , where have you been using --find-links tag? When you run the experiment how does the package show up in the ClearML UI?

  
  
Posted one year ago

From the successful task it says in the installed package dgl_cu113 == 0.9.0 I assume this is because I manually installed it in my local environment using pip instal -f
However, when trying to run hyperparameter tuning using the same job, it fails to install the package because it's not available via PyPI.

Therefore, I tried to add a requirement.txt file to the task. But that failed parsing with the error included above.

  
  
Posted one year ago

CostlyOstrich36 I used it in my local environment to install the package. From ClearML webUI, I can see that the correct version is used for the task.

  
  
Posted one year ago

How is it shown in the UI?

  
  
Posted one year ago

Can you give an example of how you installed it using --find-links (or which command used it)

  
  
Posted one year ago

pip install dgl-cu113 -f https://data.dgl.ai/wheels/repo.html

  
  
Posted one year ago

Looking at the source https://github.com/allegroai/clearml-agent/blob/9006c2d28f1fbaa42272473f23d67999cf56ab25/clearml_agent/external/requirements_parser/parser.py#L46 . It seems that this is not support by intention. Is there plan to change this in the future?

  
  
Posted one year ago

Maybe AnxiousSeal95 might have some input 🙂

  
  
Posted one year ago

Makes sense. Thanks!

  
  
Posted one year ago

Hi DefeatedMoth52 , so the reason why we don't support --find-links is that it is not in the requirements.txt standard (Or so I'm told 😄 )
What can be done is just putting the specific links to the wheel (something like https://data.dgl.ai/wheels/dgl-0.1.2-cp35-cp35m-macosx_10_6_x86_64.whl ) in the requirements.txt, and this should work. Makes sense?

  
  
Posted one year ago
592 Views
11 Answers
one year ago
one year ago
Tags