Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Does Clearml-Session Work In A Kubernetes Environment?

Does clearml-session work in a Kubernetes environment?

  
  
Posted 3 years ago
Votes Newest

Answers 18


Hi TrickySheep9
Long story short, clearml-session fully supports k8s (using k8s glue)
The --remote-gateway along side ports mode will basically allow you to setup a k8s service so that every session will register with a specific port so k8s does ingest foe you and route the SSH connection to the pod itslef, everything else is tunneled over the original SSH connection.
Make sense ?

  
  
Posted 3 years ago

Have to get glue setup, which I couldn’t understand fully, so that’s a different topic

I suggest using the apply template setup (basically you provide a Job/Service template, and it uses that to setup k8s jobs based on the Tasks coming in from the specific queue)

  
  
Posted 3 years ago

Thanks AgitatedDove14 - i get overall what you are saying. Have to get glue setup, which I couldn’t understand fully, so that’s a different topic 🙂

  
  
Posted 3 years ago

“notebook as a service” right

  
  
Posted 3 years ago

The way I read that is if you have exposed your clearml-server via k8s ingress then you can, from outside the k8s, say to clearml-session this is the k8s ingress/ip

  
  
Posted 3 years ago

I believe that's correct, yes

  
  
Posted 3 years ago

maybe I am entirely wrong .. I read clearml-session as running a remote 'headless container with jupyter'.. but not on k8s.. or rather... the pre-requisites say that 'ssh access', which you won't have in a k8s cluster (I would hope). I mean.. exposing the ssh port on a k8s cluster is jst a security nightmare.

  
  
Posted 3 years ago

Ah ok. Kind of getting it, will have to try the glue mode

  
  
Posted 3 years ago

There is kubectl exec 🙂

  
  
Posted 3 years ago

👍

  
  
Posted 3 years ago

AlertBlackbird30 - i don’t understand why it can’t be a focus though. Probably missing some context.

  
  
Posted 3 years ago

But ok the summary is I guess it doesn’t work in a k8s env

  
  
Posted 3 years ago

Hey Manoj, I am not sure how clearml-session would know how to setup kube-proxy, if that's your intent.

Personally, I would run the clearml-server and agents on the k8s cluster, and then expose the server endpoints via kube proxy or some other nicer ingress. Then you can run jupyter locally and you should be good. Jupyter session remotely running on k8s would be a logistical nightmare 🙂

  
  
Posted 3 years ago

I am guessing it could be but.. I don't feel that k8s is clearml-session's main focus/push

  
  
Posted 3 years ago

AlertBlackbird30 :

--remote-gateway [REMOTE_GATEWAY] Advanced: Specify gateway ip/address to be passed to interactive session (for use with k8s ingestion / ELB)I see this in clearml-session - what’s the intent here?

  
  
Posted 3 years ago

How is clearml-session intended to be used?

  
  
Posted 3 years ago

Ok so that’s nothing more than what I would configured in the clearml config then

  
  
Posted 3 years ago

I would like to create a notebook instance and start using it without having to do anything on a dev box

  
  
Posted 3 years ago
1K Views
18 Answers
3 years ago
one year ago
Tags
Similar posts