Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Folks, A Question Regarding The Clearml-Agent With K8S Glue. In The Agents We Mount An Nfs Volume So That Some Artifacts And Data Would Be Available For Training. I Have Seen That The K8S Glue Runs As Root (I Guess To Be Able To Spawn New Pods?), But

Hi folks, a question regarding the clearml-agent with k8s glue.
In the agents we mount an nfs volume so that some artifacts and data would be available for training.

I have seen that the k8s glue runs as root (I guess to be able to spawn new pods?), but I was wondering if there's any limitation in creating an image with a non root user to use as the actual worker?

  
  
Posted 2 years ago
Votes Newest

Answers 8


You mean as output target for artifacts?For example, for some of our models we create pdf reports, that we save in a folder in the NFS disk.

  
  
Posted 2 years ago

Hi SarcasticSquirrel56 , running an actual worker as non-root is always an issue as many processes inside the docker image rely on having root privileges...

  
  
Posted 2 years ago

For example, for some of our models we create pdf reports, that we save in a folder in the NFS disk

Oh, why not as artifacts ? at least you will be able to access from the web UI, and avoid VFS credential hell 🙂

Regrading clearml datasets:
https://www.youtube.com/watch?v=S2pz9jn26uI

  
  
Posted 2 years ago

I see... because the problem it would be with permissions when creating artifacts to store in the "/shared" folder

  
  
Posted 2 years ago

but I was wondering if there's any limitation in creating an image with a non root user to use as the actual worker?

SarcasticSquirrel56 non-root pods (containers) are fully supported,
I would recommend using the latest agent RC (that simplified a few things)
clearml-agent==1.4.0rc3

I see... because the problem it would be with permissions when creating artifacts to store in the "/shared" folder

You mean as output target for artifacts ?

especially for datasets (for the models and other files we were thinking to use the fileserver any way)

clearml-dataset ?

  
  
Posted 2 years ago

I am not aware of how clearml-dataset works, but I'll have a look 🙂

  
  
Posted 2 years ago

especially for datasets (for the models and other files we were thinking to use the fileserver any way)

  
  
Posted 2 years ago

well there are already processes in place.. we aim at migrating everything to ClearML, but we hoped we could do it gradually

  
  
Posted 2 years ago
1K Views
8 Answers
2 years ago
one year ago
Tags