Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Can I Run A Single Hyperparameter Optimization Task With At Least 100 Experiments On Multiple Machines By Using Clearml-Agent And Queue?

Hi,
can I run a single hyperparameter optimization task with at least 100 experiments on multiple machines by using clearml-agent and queue?

  
  
Posted 4 months ago
Votes Newest

Answers 9


Hi @<1664079296102141952:profile|DangerousStarfish38> , you can control it in the agent.default_docker.image section of the clearml.conf where the agent is running. You can also control it via the CLI when you use the --docker tag and finally, you can also control it via the webUI in the execution tab -> container -> image section

  
  
Posted 4 months ago

But it looks like you aren't running the agent in docker mode, at least from the log you provided . You need to add the --docker tag to the command when you run it

  
  
Posted 4 months ago

You can add torch to the installed packages section manually to get it running but I'm curious why it wasn't logged. How did you create the original experiment?

  
  
Posted 4 months ago

Did you run the code locally first? I don't see the agent installing the packages themselves, did you remove it from the log or how are the packages being installed?

  
  
Posted 4 months ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , yes you can 🙂

  
  
Posted 4 months ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , can you add a log of the execution?

  
  
Posted 4 months ago

@<1523701070390366208:profile|CostlyOstrich36> I keep failing to execute the task with clearml-agent because of environment setting.. How could I adjust clearml.conf file for the agent to use specific local environment?

  
  
Posted 4 months ago

@<1523701070390366208:profile|CostlyOstrich36> Would you mind looking over this issue?

  
  
Posted 4 months ago

@<1523701070390366208:profile|CostlyOstrich36>
My code is supposed to automatically clone a optimization task with template_task_id and execute each experiment. I didn't remove any lines from the logs.
When I run the code locally, I run it with a virtual environment activated. However, if I use clearml-agent daemon to execute the task, it seems like using a default docker image, and I don't know how to change the corresponding settings in the clearml.conf file!

  
  
Posted 4 months ago
382 Views
9 Answers
4 months ago
4 months ago
Tags