hooo now I understand, thanks for clarifying AgitatedDove14 !
Note: I can verify that post_packages is well picked up by the trains-agent, since in the experiment log I see:agent.package_manager.type = pip agent.package_manager.pip_version = \=\=20.2.3 agent.package_manager.system_site_packages = true agent.package_manager.force_upgrade = false agent.package_manager.post_packages.0 = PyJWT\=\=1.7.1
so most likely one hard requirement installs the version 2 of pyjwt while setting up the experiment
Sure. JitteryCoyote63 so what was the problem? can we fix something?
but the post_packages does not reinstalls the version 1.7.1
I can ssh into the agent and:source /trains-agent-venv/bin/activate (trains_agent_venv) pip show pyjwt Version: 1.7.1
Hi JitteryCoyote63 ,
I assume the agent installs PyJWT when setting up to run your experiment?
Are you using the agent in docker or venv mode?
Hey JitteryCoyote63 I think I need to better explain the config feature:agent.package_manager.post_packages = ["PyJWT"]
Basically this means that IF you have pyjwt in the installation package it will be installed after everything else is installed.
This doesn't mean it will always be installed.
Think for example "horovod" has to be installed after you have TF / PyTorch installed.
(The same goes for "pre_package" and Cython)
You already fixed the problem with pyjwt in the newest version of clearml/clearml-agents, so all good 😄
Ok, by setting PyJWT==1.7.1
in the setup.py of the experiment pip did not enforced the update
yes -> but I still don't understand why the post_packages didn't work, could be worth investigating