Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I'D Like To Set Up Clearml In A Kubernetes Environment. Previously, I Used The Helm Package, But It Was Not Really Configurable. Now I Intend To Use This

Hi, I'd like to set up ClearML in a Kubernetes environment. Previously, i used the helm package, but it was not really configurable. Now I intend to use this https://github.com/allegroai/clearml-server-k8s . I ran this command below.
kubectl apply -k overlays/current_versionHowever, I see that no clearml-agents are created to process the tasks. I see there is another github project, https://github.com/allegroai/clearml-agent ? However, I am not sure how to implement these instructions.

  
  
Posted 3 years ago
Votes Newest

Answers 10


image

  
  
Posted 3 years ago

image

  
  
Posted 3 years ago

When I push a job to an agent node, i got this error.
"Error response from daemon: network None not found"

  
  
Posted 3 years ago

Hi, sorry for the delayed response. Btw, all the pods are running all good.

  
  
Posted 3 years ago

It'll be good if there was yaml file to deploy clearml-agents into the k8 system.

  
  
Posted 3 years ago

Hi DeliciousBluewhale87 ,
You're correct - the k8s templates do not contain a ClearML Agent template (only a template for the Agent Services), and we're just in the process of completely moving to more configurable Helm charts.
The current Helm chart does contain a template for ClearML Agent deployment - can you explain what's missing there in terms of configuration?

  
  
Posted 3 years ago

However, I am able to get it to work, if I launch a clearml-agent outside the kubernetes ecosystem.

  
  
Posted 3 years ago

Hi, will proceed to close this thread. We found some issue with the underlying docker in our machines. We've have not shifted to another k8 of ec2 instances in AWS.

  
  
Posted 3 years ago

Hey DeliciousBluewhale87 ,
It seems like this log is the log of a task that was pulled by the agent running on the clearml-services pod, is this the case? Where did you find the above log?
Also - can you please send us the list of all the running pods in the namespace? I want to make sure the other agents are up.

  
  
Posted 3 years ago

This is where I downloaed the log. Seems like some docker issue, though i cant seem to figure it out. As an alternative, I spawned a clearml-agent outside the k8 environment and it was able to execute well.

  
  
Posted 3 years ago
1K Views
10 Answers
3 years ago
8 months ago
Tags