I believe this also impacts python 3.8 + windows btw
I think CostlyOstrich36 managed to reproduce?!
I do see that once a task fails the installed package list is updated with a full list of the environment... I don't know if that helps at all
No should be fine... Let me see if I can get a windows box 🙂
You can see installed packages with that script?
Windows 10, 3.9, using conda but even pip list should output something
Yes I just did pip list
in the env and it worked fine
I'll be your n00b w1nd0ws beta tester lol
Could it be because some of the packages then point to files?pyarrow==5.0.0
pandas @ file:///D:/bld/pandas_1624391191530/work
Okay, definitely feel better knowing I am not crazy 👍
I am using Task.force_requirements_env_freeze()
(before Task.init) with no requirements file specified (because I do not have one), and my experiments are showing this under packages:
CostlyOstrich36 did you manage to reproduce it?
I tried conda w/ python3.9 on a clean Windows VM , and it worked as expected ....
` from clearml import Task
args = {'hello': 'world'}
Task.force_requirements_env_freeze()
task = Task.init(project_name='example', task_name="Test")
task.connect(args)
task.execute_remotely() `
HelplessCrocodile8 I just tried it, everything seems to work (ubuntu 20.04) 😞
What's the OS your are using? Python version? Is it conda ?
If you have a requirements file then you can specify it:Task.force_requirements_env_freeze(requirements_file='requirements.txt')
If you just want pip freeze
output to be shown in your "Installed Packages" section then use:Task.force_requirements_env_freeze()
Notice that in both cases you should call the function Before you call Task.init()
btw, what do you mean by "Packages will be installed from projects requirements file" ?
Just making sure, pip package installed on your Conda env, correct?
HelplessCrocodile8 what version of clearml are you using?
I'm trying to accomplish that but instead of a pip freeze I just get a "Packages will be installed from projects requirements file" even though there is no projects requirements file. Do I need to do something with development.detect_with_pip_freeze
?
HelplessCrocodile8 , I managed to reproduce, hold tight 🙂
HelplessCrocodile8 , we managed to reproduce the issue. Looks like it occurs in this specific case only on python3.9 + windows. We've logged it and it should be fixed. I'll let you know when 🙂