then it works
i opened a new, clean venv just now

only clearml probably

yeah

basically, only test.py need the packages, but for somereason pipeline_test installs them as well

I'd appreciate that as there's more info there that might help understand this.

for some reason the agent tries to install the locally installed pip packages

it is installed as a pip package
but i am not using it in the code

Can you please re-post the conf file (without the credentials 🙂 )

from which we run the task

thank you! i'll try it

why those library need to run on a pipelinecontroller task, this task requires no libraries at all

the successful, which is aborted for some reason (but at least the enviorment is setup correctly)
the end of it is :

• urllib3==1.26.15
• virtualenv==20.23.0
• wcwidth==0.2.6
• Werkzeug==2.3.2
• widgetsnbextension==4.0.7
• xgboost==1.7.5
• yarl==1.9.2
  Environment setup completed successfully
  Starting Task Execution:
  2023-04-29 21:41:02
  Process terminated by user

You can use Task.ignore_requirements("pywin32") in your code - that should solve it

Basically, it looks like the agent installs an outdated pip version and this should fix it, and hopefully install your packages correctly

Hi @<1544853695869489152:profile|NonchalantOx99> , can you share the successful and unsuccessful logs?

but why does it matter if i ran it on a remote agent?

not using it in the code

i reproduced it here:

OK, we'll take a look

Are you sure you're not using pywin32? The ClearML SDK does static code analysis and should only store the packages you reference directly

the unsuccesslful:
Using cached meteostat-1.6.5-py3-none-any.whl (31 kB)
Requirement already satisfied: neuralprophet==0.5.3 in /usr/local/lib/python3.9/site-packages (from -r /tmp/cached-reqs58y_jg9f.txt (line 9)) (0.5.3)
Requirement already satisfied: numpy==1.23.5 in /usr/local/lib/python3.9/site-packages (from -r /tmp/cached-reqs58y_jg9f.txt (line 10)) (1.23.5)
Requirement already satisfied: pandas==1.5.3 in /usr/local/lib/python3.9/site-packages (from -r /tmp/cached-reqs58y_jg9f.txt (line 11)) (1.5.3)
ERROR: Could not find a version that satisfies the requirement pywin32==305 (from -r /tmp/cached-reqs58y_jg9f.txt (line 12)) (from versions: none)
ERROR: No matching distribution found for pywin32==305 (from -r /tmp/cached-reqs58y_jg9f.txt (line 12))
clearml_agent: ERROR: Could not install task requirements!
Command '['/root/.clearml/venvs-builds/3.9/bin/python', '-m', 'pip', '--disable-pip-version-check', 'install', '-r', '/tmp/cached-reqs58y_jg9f.txt']' returned non-zero exit status 1.
2023-04-29 21:49:50
Process failed, exit code 1

And what are the installed packages showing in the task UI panel?

Hi @<1544853695869489152:profile|NonchalantOx99> ! In your clearml.conf , try to set, at the end of the whole file, outside any curly brackets, agent.package_manager.pip_version: "23.1.2"

just a sec

So the question is why did pywin32 == 305 got into the installed packages - are you using that in your code?

what happens if you uninstall it and than try to run the code?

Also, It would help to see the clearml.conf file from the local environment that started running this task

do you want the entire log files? (it is a pipeline, and i can't seem to find the "Task" itself, to download the logs)

and then it works, doesn't try to install any other packages

Well, what are the local libraries? obviously you're using some of them, so they need to be there