Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi I Have Another Question: I Run The Following Line With Allegro: Assert Os.Path.Exists("Path") This Path Does Not Exist. How Is It Possible To Have Access To Folders Outside The Git Repo?

Hi
I have another question:
I run the following line with allegro:
assert os.path.exists("path")
This path does not exist. How is it possible to have access to folders outside the git repo?

  
  
Posted 3 years ago
Votes Newest

Answers 19


Are you running the task locally? Or using a ClearML agent?

  
  
Posted 3 years ago

i do not have access to the folder

What does that mean? Are you getting an error?

  
  
Posted 3 years ago

i run it on the same machine

  
  
Posted 3 years ago

And is the external path you want to mount also found in the machine where the agent is running?

  
  
Posted 3 years ago

i think there is a problem with docker. because i am in the docker container and I have to use volume mount to get access to paths outside the container.
But i dont know how to use volume mount exactly

  
  
Posted 3 years ago

thanks for the info
I have time now
how can I use "volume mount" with allegro?

  
  
Posted 3 years ago

i run it with docker mode

  
  
Posted 3 years ago

if i start the script via the console then the path is available but if i start a training via the graphical interface of allegro then not

  
  
Posted 3 years ago

Sorry.. we are currently swamped with ODSC East requests and presentations etc 😄

  
  
Posted 3 years ago

assert os.path.exists("path")
with this line I get the error that the path does not exist

  
  
Posted 3 years ago

clearml-agent --config-file /home/chuber/clearml.conf daemon --detached --gpus 1
--queue KA_ML2_GPU1 --docker nvidia/cuda:10.1-cudnn7-devel

  
  
Posted 3 years ago

quick question if I may, are you running clearml-agent with --docker mode or without ? are you running the clearml-agent on the same machine as the path exists on another machine entirely ?

  
  
Posted 3 years ago

UnsightlySeagull42 as AlertBlackbird30 kind of pointed out, the issue is probably that when you're running your agent in docker mode, it runs the task inside the docker container which has its own virtual file system (so your external folder/file is not found there). In order for your folder/file to be accessible, you'll need to add a volume mount - we'll be happy to explain when you have the time 🙂

  
  
Posted 3 years ago

i try to run the agent without docker. Without docker mode the path is available. But i need docker for tensorflow and cuda

  
  
Posted 3 years ago

first i run it locally. This works. But then I use the clearML agent and then it does not work

  
  
Posted 3 years ago

What exactly are you running (agent configuration)?

  
  
Posted 3 years ago

Hi UnsightlySeagull42 , you can always use a relative or absolute path (that's just Python, not related to ClearML). What exactly do you need to access?

  
  
Posted 3 years ago

I need to access to a tfrecord file
but with allegro i do not have access to the folder

  
  
Posted 3 years ago

understand. Are you comfortable with docker ? If so, I would probably suggest doing a docker run -it <identifier> bash and seeing if that folder does, indeed, exist in the docker image

  
  
Posted 3 years ago
1K Views
19 Answers
3 years ago
one year ago
Tags