Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I'M A Little Confused As To How Force_Requirements_Env_Freeze Works When No Requirements File Is Supplied. Is It Supposed To Store The Full Reqs Of The Environment That Calls It?

I'm a little confused as to how force_requirements_env_freeze works when no requirements file is supplied. Is it supposed to store the full reqs of the environment that calls it?

  
  
Posted 3 years ago
Votes Newest

Answers 28


I think CostlyOstrich36 managed to reproduce?!

  
  
Posted 3 years ago

1.1.1

  
  
Posted 3 years ago

Correct (basically pip freeze results)

  
  
Posted 3 years ago

Thanks

  
  
Posted 3 years ago

No should be fine... Let me see if I can get a windows box 🙂

  
  
Posted 3 years ago

I'll be your n00b w1nd0ws beta tester lol

  
  
Posted 3 years ago

Could it be because some of the packages then point to files?
pyarrow==5.0.0
pandas @ file:///D:/bld/pandas_1624391191530/work

  
  
Posted 3 years ago

HelplessCrocodile8 what version of clearml are you using?

  
  
Posted 3 years ago

Dang that's not good news for me

  
  
Posted 3 years ago

Yep, everything (both conda and pip)

  
  
Posted 3 years ago

I am using Task.force_requirements_env_freeze() (before Task.init) with no requirements file specified (because I do not have one), and my experiments are showing this under packages:

  
  
Posted 3 years ago

CostlyOstrich36 did you manage to reproduce it?
I tried conda w/ python3.9 on a clean Windows VM , and it worked as expected ....

  
  
Posted 3 years ago

I'm trying to accomplish that but instead of a pip freeze I just get a "Packages will be installed from projects requirements file" even though there is no projects requirements file. Do I need to do something with development.detect_with_pip_freeze ?

  
  
Posted 3 years ago

HelplessCrocodile8 , I managed to reproduce, hold tight 🙂

  
  
Posted 3 years ago

Yes

  
  
Posted 3 years ago

` from clearml import Task

args = {'hello': 'world'}

Task.force_requirements_env_freeze()
task = Task.init(project_name='example', task_name="Test")
task.connect(args)
task.execute_remotely() `

  
  
Posted 3 years ago

Okay, definitely feel better knowing I am not crazy 👍

  
  
Posted 3 years ago

I do see that once a task fails the installed package list is updated with a full list of the environment... I don't know if that helps at all

  
  
Posted 3 years ago

pip freezeworks ?

  
  
Posted 3 years ago

If you have a requirements file then you can specify it:
Task.force_requirements_env_freeze(requirements_file='requirements.txt')
If you just want pip freeze output to be shown in your "Installed Packages" section then use:
Task.force_requirements_env_freeze()
Notice that in both cases you should call the function Before you call Task.init()
btw, what do you mean by "Packages will be installed from projects requirements file" ?

  
  
Posted 3 years ago

HelplessCrocodile8 , we managed to reproduce the issue. Looks like it occurs in this specific case only on python3.9 + windows. We've logged it and it should be fixed. I'll let you know when 🙂

  
  
Posted 3 years ago

Okay, thanks for looking into it

  
  
Posted 3 years ago

Yes I just did pip list in the env and it worked fine

  
  
Posted 3 years ago

You can see installed packages with that script?

  
  
Posted 3 years ago

Windows 10, 3.9, using conda but even pip list should output something

  
  
Posted 3 years ago

I believe this also impacts python 3.8 + windows btw

  
  
Posted 3 years ago

Just making sure, pip package installed on your Conda env, correct?

  
  
Posted 3 years ago

HelplessCrocodile8 I just tried it, everything seems to work (ubuntu 20.04) 😞
What's the OS your are using? Python version? Is it conda ?

  
  
Posted 3 years ago
936 Views
28 Answers
3 years ago
one year ago
Tags