Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey Guys, Is There A Way To Dynamically Know The Path Of A Cloned Github Project (And Task) Inside A Docker Mode Worker? I Want To Set The Pythonpath Inside My Docker Worker, So I Can Access Local Modules, And My Only Problem Is That The Path Depends On T

hey guys, is there a way to dynamically know the path of a cloned github project (and task) inside a docker mode worker?
I want to set the PYTHONPATH inside my docker worker, so I can access local modules,
and my only problem is that the path depends on the worker
for example, i see that the current path is:
File "/root/.clearml/venvs-builds/3.10/task_repository/assaf.git"

is there a way for me to know that dyanamicly?

  
  
Posted one year ago
Votes Newest

Answers 4


That's fabulous. This is definitely how my team prefers to structure projects. I hadn't gotten around to trying that out in our POC of ClearML yet, but I'm certain this is how our group will solve this problem

  
  
Posted one year ago

Just chiming in - @<1541954607595393024:profile|BattyCrocodile47> ’s comment is a very good practice, and works well 🙂

  
  
Posted one year ago

ok, it is solved with the force_git_root_python_path: true in clearml.conf

  
  
Posted one year ago

I don't know about this, but could you turn your whole project into a pip-installable package using a setup.py and/or pyproject.toml ?

I've never tried this, but maybe then you could do pip install -e . locally before executing the task. Then execute. And then maybe the pip freeze that ClearML does would contain the symlink to your directory.

(so that from my_package import ... statements would work)

  
  
Posted one year ago
1K Views
4 Answers
one year ago
one year ago
Tags