Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Folks, A Question Regarding The Clearml-Agent With K8S Glue. In The Agents We Mount An Nfs Volume So That Some Artifacts And Data Would Be Available For Training. I Have Seen That The K8S Glue Runs As Root (I Guess To Be Able To Spawn New Pods?), But

Hi folks, a question regarding the clearml-agent with k8s glue.
In the agents we mount an nfs volume so that some artifacts and data would be available for training.

I have seen that the k8s glue runs as root (I guess to be able to spawn new pods?), but I was wondering if there's any limitation in creating an image with a non root user to use as the actual worker?

  
  
Posted one year ago
Votes Newest

Answers 8


Hi SarcasticSquirrel56 , running an actual worker as non-root is always an issue as many processes inside the docker image rely on having root privileges...

  
  
Posted one year ago

You mean as output target for artifacts?For example, for some of our models we create pdf reports, that we save in a folder in the NFS disk.

  
  
Posted one year ago

I am not aware of how clearml-dataset works, but I'll have a look 🙂

  
  
Posted one year ago

well there are already processes in place.. we aim at migrating everything to ClearML, but we hoped we could do it gradually

  
  
Posted one year ago

but I was wondering if there's any limitation in creating an image with a non root user to use as the actual worker?

SarcasticSquirrel56 non-root pods (containers) are fully supported,
I would recommend using the latest agent RC (that simplified a few things)
clearml-agent==1.4.0rc3

I see... because the problem it would be with permissions when creating artifacts to store in the "/shared" folder

You mean as output target for artifacts ?

especially for datasets (for the models and other files we were thinking to use the fileserver any way)

clearml-dataset ?

  
  
Posted one year ago

For example, for some of our models we create pdf reports, that we save in a folder in the NFS disk

Oh, why not as artifacts ? at least you will be able to access from the web UI, and avoid VFS credential hell 🙂

Regrading clearml datasets:
https://www.youtube.com/watch?v=S2pz9jn26uI

  
  
Posted one year ago

especially for datasets (for the models and other files we were thinking to use the fileserver any way)

  
  
Posted one year ago

I see... because the problem it would be with permissions when creating artifacts to store in the "/shared" folder

  
  
Posted one year ago
633 Views
8 Answers
one year ago
one year ago
Tags