Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
When Trains-Agent Is Configured With

when trains-agent is configured with system_site_packages: true why agent tries to create a new env and install packages ?

  
  
Posted 4 years ago
Votes Newest

Answers 11


Hi PompousParrot44
Could you send the "Installed Packages" list?
I think there is a bug in the current trains-agent (there is already a fix but the RC is still not out),
where "packeg @ git+http" packages ignore the git+http link.
You can solve it manually by just editing the "Installed packages" (when Task is in draft mode, the section becomes editable), and remove the "package @" part, and leave the "git+http" link.

  
  
Posted 4 years ago

is it because of something wrong with this package build from their owner or something else

  
  
Posted 4 years ago

Hi PompousParrot44 ,
The agent always creates a new virtualenv. When system_site_packages: true the venv inherits system-installes packages and should not reinstall them if the requirement is satisfied. This way your experiment is still isolated, but any pre-installed/prebuilt package need not be downloaded and installed again

  
  
Posted 4 years ago

ok... is there any way to enforce using a given system wide env.. so agent doesn't need to spend time with env. creation

  
  
Posted 4 years ago

Right now, no, although the venv creation itself does not take lots of time...

  
  
Posted 4 years ago

AgitatedDove14 it seems i am having issues when i restart the agent... it fails in creating/setting up the env again... when i clean up the .trains/venv-builds folder and run a job for agent.. it is able to create the env fine and run job successfully.. when i restart the agent it fails with messages like
Requirement already satisfied: cffi@ file:///home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work from file:///home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work in /opt/anaconda3/envs/secanairap/lib/python3.7/site-packages (1.14.1) Processing /home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: '/home/conda/feedstock_root/build_artifacts/cffi_1595805535531/work'

  
  
Posted 4 years ago

thanks for the update... it seems currently i can not pass the http/s proxy parameters as when agent creates a new env and try to download some package its being blocked by our corp firewall... all outgoing connection needs to pass through a proxy.. so is it possible to specify that or environment variables to agent

  
  
Posted 4 years ago

thanks for letting me know.. but it turns out after i have recreated my whole system environment from scratch, trains agent is working as expected..

  
  
Posted 4 years ago

as when it run first time after .trains/venv-build cleaning, it output this message for this package - pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1593275161868/work wondering why it specify this package as for most other packages it just prints the version number

  
  
Posted 4 years ago

PompousParrot44 the venv created in the docker always inherits form the docker system-wide packages, so in essence if you are using the same set pf python packages, nothing will get reinstalled.

  
  
Posted 4 years ago

i understand.. its just if i have a docker image with correct env.. i would prefer if trains-agent can use that directly

  
  
Posted 4 years ago