Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Is There Any Examples Of Mounting An Aws Efs Mount To A Self Hosted K8 Agent Deploy?

Is there any examples of mounting an AWS EFS mount to a self hosted k8 agent deploy? https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L72-L80

  
  
Posted one year ago
Votes Newest

Answers 10


I got the EFS volume mounted. Curious what advantage it would be to use the StorageManager

  
  
Posted one year ago

Hi BoredHedgehog47
You mean like EFS for caching ?

  
  
Posted one year ago

EFS get downloaded to the k8 pod local volume?

EFS is an Amazon service that mounts a persistent FS into ec2 instances, I believe they have support for k8s as a service as well, which would make it kind of like a PV only as a service.
Does that make sense ?

  
  
Posted one year ago

Does the file on the EFS get downloaded to the k8 pod local volume?

  
  
Posted one year ago

Okay, makes sense. So there is no copying of the data to the pod, it is simply references via the EFS

  
  
Posted one year ago

Yes, as an example: My task starts up and checks the mounted EFS volume for x data, if x data does not exist there, it then pulls x data from S3.

  
  
Posted one year ago

. Curious what advantage it would be to use the StorageManager

Basically if you set the clearml cache folder to the EFS, users can always do:
from clearml import StorageManager local_file = StorageManager.get_local_copy(" ")where local_file is stored on persistent cache (EFS) and the cache is automatically cleaned based on last accessed file

  
  
Posted one year ago

My task starts up and checks the mounted EFS volume for x data, if x data does not exist there, it then pulls x data from S3.

BoredHedgehog47 you can just use StorageManager and configure clearml cache for the EFS, it will essentially do the same 🙂
Regrading helm chart with EFS,
you need to configure the clearml-glue pod template with the EFS mount
example :
https://github.com/kubernetes-sigs/aws-efs-csi-driver/blob/e7f647f4e6fc76f983d61522e635353005f1472f/examples/kubernetes/volume_path/specs/example.yaml#L18
Then you need to point clearml cache to the mount point by setting the env var CLEARML_CACHE_DIR
wdyt?

  
  
Posted one year ago

It seems like https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml#L72-L80 doesn't actually do anything as the values set here aren't applied in the agent template

  
  
Posted one year ago

So there is no copying of the data to the pod, it is simply references via the EFS

Correct

  
  
Posted one year ago
645 Views
10 Answers
one year ago
one year ago
Tags