thanks for letting me know.. but it turns out after i have recreated my whole system environment from scratch, trains agent is working as expected..
Hi PompousParrot44
Could you send the "Installed Packages" list?
I think there is a bug in the current trains-agent (there is already a fix but the RC is still not out),
where "packeg @ git+http" packages ignore the git+http link.
You can solve it manually by just editing the "Installed packages" (when Task is in draft mode, the section becomes editable), and remove the "package @" part, and leave the "git+http" link.
is it because of something wrong with this package build from their owner or something else
as when it run first time after .trains/venv-build
cleaning, it output this message for this package - pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1593275161868/work
wondering why it specify this package as for most other packages it just prints the version number
AgitatedDove14 it seems i am having issues when i restart the agent... it fails in creating/setting up the env again... when i clean up the .trains/venv-builds
folder and run a job for agent.. it is able to create the env fine and run job successfully.. when i restart the agent it fails with messages likeRequirement already satisfied: cffi@ file:///home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work from file:///home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work in /opt/anaconda3/envs/secanairap/lib/python3.7/site-packages (1.14.1) Processing /home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: '/home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work'
thanks for the update... it seems currently i can not pass the http/s proxy parameters as when agent creates a new env and try to download some package its being blocked by our corp firewall... all outgoing connection needs to pass through a proxy.. so is it possible to specify that or environment variables to agent
PompousParrot44 the venv created in the docker always inherits form the docker system-wide packages, so in essence if you are using the same set pf python packages, nothing will get reinstalled.
i understand.. its just if i have a docker image with correct env.. i would prefer if trains-agent can use that directly
Right now, no, although the venv creation itself does not take lots of time...
ok... is there any way to enforce using a given system wide env.. so agent doesn't need to spend time with env. creation
Hi PompousParrot44 ,
The agent always creates a new virtualenv. When system_site_packages: true
the venv inherits system-installes packages and should not reinstall them if the requirement is satisfied. This way your experiment is still isolated, but any pre-installed/prebuilt package need not be downloaded and installed again