ok... is there any way to enforce using a given system wide env.. so agent doesn't need to spend time with env. creation
as when it run first time after .trains/venv-build cleaning, it output this message for this package - pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1593275161868/work wondering why it specify this package as for most other packages it just prints the version number
Right now, no, although the venv creation itself does not take lots of time...
Hi PompousParrot44 ,
The agent always creates a new virtualenv. When system_site_packages: true the venv inherits system-installes packages and should not reinstall them if the requirement is satisfied. This way your experiment is still isolated, but any pre-installed/prebuilt package need not be downloaded and installed again
Hi PompousParrot44
Could you send the "Installed Packages" list?
I think there is a bug in the current trains-agent (there is already a fix but the RC is still not out),
where "packeg @ git+http" packages ignore the git+http link.
You can solve it manually by just editing the "Installed packages" (when Task is in draft mode, the section becomes editable), and remove the "package @" part, and leave the "git+http" link.
PompousParrot44 the venv created in the docker always inherits form the docker system-wide packages, so in essence if you are using the same set pf python packages, nothing will get reinstalled.
is it because of something wrong with this package build from their owner or something else
thanks for the update... it seems currently i can not pass the http/s proxy parameters as when agent creates a new env and try to download some package its being blocked by our corp firewall... all outgoing connection needs to pass through a proxy.. so is it possible to specify that or environment variables to agent
thanks for letting me know.. but it turns out after i have recreated my whole system environment from scratch, trains agent is working as expected..
AgitatedDove14 it seems i am having issues when i restart the agent... it fails in creating/setting up the env again... when i clean up the .trains/venv-builds folder and run a job for agent.. it is able to create the env fine and run job successfully.. when i restart the agent it fails with messages likeRequirement already satisfied: cffi@ file:///home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work from file:///home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work in /opt/anaconda3/envs/secanairap/lib/python3.7/site-packages (1.14.1) Processing /home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: '/home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work'
i understand.. its just if i have a docker image with correct env.. i would prefer if trains-agent can use that directly