Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Can You Pls Help Me? I Am Using V 0.14 (Will Update It Soon) And I Got The Following Error: /Usr/Bin/Python3.6: No Module Named Virtualenv Trains_Agent: Error: Command '['Python3.6', '-M', 'Virtualenv', '/Home/Ubuntu/.Trains/Venvs-Builds.2/3.6']' Ret

hi, can you pls help me?
I am using v 0.14 (will update it soon)
and I got the following error:

/usr/bin/python3.6: No module named virtualenv
trains_agent: ERROR: Command '['python3.6', '-m', 'virtualenv', '/home/ubuntu/.trains/venvs-builds.2/3.6']' returned non-zero exit status 1.

but agent.default_python = 3.7 so I don't understand why it went to python3.6 and not 3.7...

  
  
Posted 4 years ago
Votes Newest

Answers 30


in the "original one"'s log i see:
TRAINS Task: created new task id=2eec56cb60e9441897a4af9c10f656c0
TRAINS new package available: UPGRADE to v0.15.0 is recommended!
Release Notes:
Features

  • Add automation support including hyper-parameters optimization (see example here )
  • Task.init() auto_connect_arg_parser argument can accept a dictionary disabling specific keys from the argparser (Trains Slack channel thread )
  • Allow worker_id override using TRAINS_WORKER_NAME environment variable (Trains Slack channel thread )
  • Support layout configuration for plotly objects using extra_layout argument in all Logger reporting methods #136
  • Add Task.execute_remotely() to allow cloning and enqueuing a locally executed task (or stopping and re-enqueuing a remotely executed task) #128
  • Add Parquet framework and model type
  • Support recursive model folder packaging
  • Add Task.get_reported_console_output() and Task.get_reported_scalars() to allow retrieval of reported reported output and scalar metrics
  • Add Task.add_requirements() to force requirement package into "installed packages"
  • Improve task reuse responsiveness
  • Add raise_on_error (default False) argument to Model.get_local_copy() and Artifact.get_local_copy() https://github.com/allegroai/trains-agent/issues/17
  • Support Task.get_task() without project name (i.e. all projects)
  • Support using the file calling Task.init() as the task's script in case sys.argv doesn't point to a git repository
  • Support detecting and remotely executing code running from a module (i.e. -m module)
  • Add callback for framework save/load binding for better integration with pytorch/ignite https://github.com/pytorch/ignite/issues/1056
  • Support new task types provided in Trains Server v0.15.0
  • Add automation and distributed examples
  • Upgrade default pip version to <20.2
    Bug Fixes
  • Fix exact_match_regex() in case of empty pattern #138
  • Address deprecation warning and newer attrs versions in MetricsEventAdapter #134
  • Fix issues with plotly support (Trains Slack channel thread and thread )
  • Fix default argument behavior to match argparse behavior
  • Fix OutputModel with task=None should use current task, if exists
  • Fix Task.get_task() to raise proper error on incorrect task_id
  • Fix Task.enqueue() to use an exact queue name match
  • Fix NaN, Inf and -Inf values display in reported table (not supported by JSON)
  • Limit max requirement size to 0.5MB
  • Fix issues with repository analysis
  • Fix StorageManager should only try to extract .zip files, Model should not auto extract package https://github.com/allegroai/trains-agent/issues/17
    TRAINS results page: http://trains.agro-scout.com:8080/projects/071e139ad6084f2493ff00fe9181f825/experiments/2eec56cb60e9441897a4af9c10f656c0/output/log
    inference
  
  
Posted 4 years ago

Yes actually that might be it. Here is how it works,
It launch a thread in the background to do all the analysis of the repository, extracting all the packages.
If the process ends (for any reason), it will give the background thread 10 seconds to finish and then it will give up. If the repository is big, the analysis can take longer, and it will quit

  
  
Posted 4 years ago

so it should be installed?

  
  
Posted 4 years ago

yes

  
  
Posted 4 years ago

We actually added a specific call to stop the local execution and continue remotely , see it here: https://github.com/allegroai/trains/blob/master/trains/task.py#L2409

  
  
Posted 4 years ago

(the Clone)

  
  
Posted 4 years ago

i can send requirements.txt if needed

  
  
Posted 4 years ago

and keras and many others...

  
  
Posted 4 years ago

because it should have detected it...
Did you see "Repository and package analysis timed out ..."

  
  
Posted 4 years ago

at the end of the manual execution

  
  
Posted 4 years ago

yes

  
  
Posted 4 years ago

No the "original one"

  
  
Posted 4 years ago

?

  
  
Posted 4 years ago

"Trains will analyze the entire repository if this is a git repo" it is a git repo...

  
  
Posted 4 years ago

(with the right branch, commit and all...)

  
  
Posted 4 years ago

do you have git repo link in the execution section of the experiment ?

  
  
Posted 4 years ago

I ran it till the end first time and it ended successfully but i put the trains commend line on comment so i didn't see it on trains,,, so i ran it again and stoped it at the middle...

  
  
Posted 4 years ago

in the clone I see "Environment setup completed successfully" and nothing about timeout

  
  
Posted 4 years ago

and it continues... but nothing about time out

  
  
Posted 4 years ago

if i stopped the running of the Original one before it ended, can it be the problem?

  
  
Posted 4 years ago

It should be the last line (or almost) of the Log. is it there ? Also it seems that from the log, that trains you are using trains 0.14.3 , try with trains 0.15 , let me know if you are still missing packages

  
  
Posted 4 years ago

and do you have import tensorflow in your code?

  
  
Posted 4 years ago

If the problem consists (i.e. trains failing to detect packages, please open a GitHub Issue so the bug will not get lost 🙂

  
  
Posted 4 years ago

ok, thank you 🙂 i will check it

  
  
Posted 4 years ago

@ https://app.slack.com/team/UT8T0V3NE ok so I see the packages that are listed are the ones that are imported on the python script that runs but it doesn't include the ones it needs from imports from other inner classes... I guess it is the way it works, so i need to specify all the packages that are not on the py script i run? (all the packages that the inner classes are using)

  
  
Posted 4 years ago

@ https://app.slack.com/team/UT8T0V3NE any idea for what is the reason they are not listed there?

  
  
Posted 4 years ago

so yea... the packages are not there...

  
  
Posted 4 years ago

OK I guess you ment the installed packages on the execution tab and i looked at the log.. so there i see the following:

Python 3.7.5 (default, Nov 7 2019, 10:50:52) [GCC 8.3.0]

argparse_utils == 1.3.0
trains == 0.14.3

Detailed import analysis

**************************

IMPORT PACKAGE argparse_utils

simple_pipe2.py: 10

IMPORT PACKAGE trains

simple_pipe2.py: 9

  
  
Posted 4 years ago

the one i cloned?

  
  
Posted 4 years ago

PlainSquid19 Trains will analyze the entire repository if this is a git repo code, and a single script file if there is no repository found.

It will not analyze an entire folder if it is not in a git repository, because it will not be able to recreate this folder anyhow. Make sense ?

  
  
Posted 4 years ago
1K Views
30 Answers
4 years ago
one year ago
Tags