Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, If I Want To Run Many Hyperparameter Tuning Trials In Parallel E.G. 50 Trials Concurrently, What'S The Best Way To Do It In The Cloud? I Have An Aws Account But Not Much Knowledge About Stuff Like Kubernetes. Should I Use The Premium Version Of Clearm

Hi, If I want to run many hyperparameter tuning trials in parallel e.g. 50 trials concurrently, what's the best way to do it in the cloud? I have an AWS account but not much knowledge about stuff like Kubernetes. Should I use the premium version of ClearML? Is there any simple and practical tutorial for how to setup your cloud system for ClearML?

  
  
Posted 2 years ago
Votes Newest

Answers 6


AgitatedDove41 Hi!

If I understand correctly you would like to run the training on AWS?

  
  
Posted 2 years ago

Yes, on AWS or on anything as long as it's not too hard for someone who doesn't know much DevOps stuff.
Ideally I want it to automatically spawn new compute instances when required and terminate the instances when not in use.

  
  
Posted 2 years ago

It can be also on ClearML. I'm just evaluating options currently. Is the free version suitable for running big experiment like that? (50-100 trials concurrent for maybe an hour and then stop)
My workflow is that I like to try a bunch of parameters (50-100 trials at a time) and then develop idea of what to do next.

  
  
Posted 2 years ago

AgitatedDove41 , you can run as many instances as you'd like 🙂

Please read this to see how it's done with AWS. I don't believe you need much DevOps knowledge 🙂

  
  
Posted 2 years ago

Thank you for the link, I'll learn how to do it.

  
  
Posted 2 years ago

AgitatedDove41 , forgot to add the link for the docs, here it is:

https://clear.ml/docs/latest/docs/guides/services/aws_autoscaler/

  
  
Posted 2 years ago
567 Views
6 Answers
2 years ago
one year ago
Tags