Basically, it looks like the agent installs an outdated pip version and this should fix it, and hopefully install your packages correctly
Hi @<1544853695869489152:profile|NonchalantOx99> ! In your clearml.conf
, try to set, at the end of the whole file, outside any curly brackets, agent.package_manager.pip_version: "23.1.2"
basically, only test.py need the packages, but for somereason pipeline_test installs them as well
Well, can you share some of the code (or at least the imports it has)? The SDK created the installed packages list to make sure the task will not fail when being run by the agent
why those library need to run on a pipelinecontroller task, this task requires no libraries at all
but why does it matter if i ran it on a remote agent?
Well, what are the local libraries? obviously you're using some of them, so they need to be there
is it possible to tell him not the install my local libraries all at once? instead of manually saying ignore_requirements?
You can use Task.ignore_requirements("pywin32")
in your code - that should solve it
and then it works, doesn't try to install any other packages
then it works
i opened a new, clean venv just now
what happens if you uninstall it and than try to run the code?
it is installed as a pip package
but i am not using it in the code
Are you sure you're not using pywin32? The ClearML SDK does static code analysis and should only store the packages you reference directly
Can you please re-post the conf file (without the credentials 🙂 )
So the question is why did pywin32 == 305
got into the installed packages - are you using that in your code?
Also, It would help to see the clearml.conf file from the local environment that started running this task
And what are the installed packages showing in the task UI panel?
for some reason the agent tries to install the locally installed pip packages
I'd appreciate that as there's more info there that might help understand this.
do you want the entire log files? (it is a pipeline, and i can't seem to find the "Task" itself, to download the logs)
the successful, which is aborted for some reason (but at least the enviorment is setup correctly)
the end of it is :
- urllib3==1.26.15
- virtualenv==20.23.0
- wcwidth==0.2.6
- Werkzeug==2.3.2
- widgetsnbextension==4.0.7
- xgboost==1.7.5
- yarl==1.9.2
Environment setup completed successfully
Starting Task Execution:
2023-04-29 21:41:02
Process terminated by user