Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I'M Using The K8S Glue And Have A Few Questions.

Hi, I'm using the k8s glue and have a few questions.
Noted that it's not requesting the http://nvidia.com/gpu thus the pod created doesn't have a GPU resource. How should I create it? I would like to pass some arguments when it's installing python package (e.g --trusted-host). There are times when I want to use the global python packages instead of virtual python env. Can I do that?

  
  
Posted 3 years ago
Votes Newest

Answers 8


For me too, had this issue.. I realised that k8s glue, wasnt using the GPU resource compared to running it as clearml-agent..TimelyPenguin76 suggested using the latest Cuda11.0 images, though it also didnt work.

  
  
Posted 3 years ago

Encountered this issue too. For k8s_glue_example.py I added in argument —overrides-yaml=<yaml file> which contains

spec:
containers:

The pod is able to be allocated with gpu.

  
  
Posted 3 years ago

Clear-ml agent does have a build flag install-globally.. That may get you where you want to go

  
  
Posted 3 years ago

I think the default action of clearml-agent k8s glue when running a task is to create a virtual env and installing the dependancies. So i'm just checking how to change that behaviour to look at global instead.

  
  
Posted 3 years ago

Hi, it's a preference from my developers. They preferred that the they install the python libraries into the images, load them up into the registry. In other words, they prefer to have libraries installed at image time.

  
  
Posted 3 years ago

Any comments on using the global python libraries without the need to 'pip install' anything?

  
  
Posted 3 years ago

SubstantialElk6 I am having a bit of a monday morning (on a wednesday, not good)

since python is running inside a docker/cri-o/containerd in k8s anyway, what would you gain from using the installed global python libraries ?? Any libs would have to be installed at container time anyway so.. urm. yeah.

feel free to treat me like an idiot and use small words to explain, I honestly don't mind 🙂 I could be missing something in your use case (more than likely)

  
  
Posted 3 years ago

I would assume, from the sounds of it, that you are using the dockerfile to pip install python libs.. In which case a pip install clear-ml can also be done at image creation time.. I don't know what other methods you would be using to install python deps.. Easy_install?!?

  
  
Posted 3 years ago