Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, When I Clone And Enqueue A Task Using The Web-Console, Is There Anyway To Add A Pre-Execution Hook To That Cloned Task? More Specifically, My Code Uses A Bunch Of Resources Off The Local Disk Which Are Setup Independently Of The Code Itself. When I

Hello,
When I clone and enqueue a task using the web-console, is there anyway to add a pre-execution hook to that cloned task?
More specifically, my code uses a bunch of resources off the local disk which are setup independently of the code itself. When I clone an experiment, it runs in it's own venv location which doesn't have access to these resources. Is there a way I can get the task to call a script that can setup these resources in the cloned task dir, without having to do that for my original task or in my code?

  
  
Posted 2 years ago
Votes Newest

Answers 6


I'm looking at the docs on docker mode and running the script. Is this script run after the venv and code dir are setup, or immediately after the container starts but before the environment for running the experiment is setup?

  
  
Posted 2 years ago

Yes, but is it run after the requirements are installed and the code is mounted? The docs say
If we look at the console output in the web UI, the third entry should start with Executing: ['docker', 'run', '-t', '--gpus...', and towards the end of the entry, where the downloaded packages are mentioned, we can see the additional shell-script apt-get install -y bindfs.which seems like that would be the case but I'm not sure what the 1st or 2nd entries are and so want to confirm.

  
  
Posted 2 years ago

so there's no way to do that when running in pip or conda mode?

  
  
Posted 2 years ago

Hi JumpyPig73 , extra_docker_shell_script is only used in docker mode 🙂

  
  
Posted 2 years ago

The Agent pulls the Task, and then reproduces it, and now it will execute the extra_docker_shell_script that was put in the configuration file.Does this imply the former? Env is fully setup, then script is run, then experiment is started by calling the executable?

  
  
Posted 2 years ago

If you run in docker mode you can specify startup shell script

  
  
Posted 2 years ago
1K Views
6 Answers
2 years ago
one year ago
Tags