Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Can I Run A Single Hyperparameter Optimization Task With At Least 100 Experiments On Multiple Machines By Using Clearml-Agent And Queue?

Hi,
can I run a single hyperparameter optimization task with at least 100 experiments on multiple machines by using clearml-agent and queue?

  
  
Posted one month ago
Votes Newest

Answers 9


Hi @<1664079296102141952:profile|DangerousStarfish38> , yes you can 🙂

  
  
Posted one month ago

You can add torch to the installed packages section manually to get it running but I'm curious why it wasn't logged. How did you create the original experiment?

  
  
Posted one month ago

But it looks like you aren't running the agent in docker mode, at least from the log you provided . You need to add the --docker tag to the command when you run it

  
  
Posted one month ago

@<1523701070390366208:profile|CostlyOstrich36> Would you mind looking over this issue?

  
  
Posted one month ago

Did you run the code locally first? I don't see the agent installing the packages themselves, did you remove it from the log or how are the packages being installed?

  
  
Posted one month ago

@<1523701070390366208:profile|CostlyOstrich36> I keep failing to execute the task with clearml-agent because of environment setting.. How could I adjust clearml.conf file for the agent to use specific local environment?

  
  
Posted one month ago

@<1523701070390366208:profile|CostlyOstrich36>
My code is supposed to automatically clone a optimization task with template_task_id and execute each experiment. I didn't remove any lines from the logs.
When I run the code locally, I run it with a virtual environment activated. However, if I use clearml-agent daemon to execute the task, it seems like using a default docker image, and I don't know how to change the corresponding settings in the clearml.conf file!

  
  
Posted one month ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , you can control it in the agent.default_docker.image section of the clearml.conf where the agent is running. You can also control it via the CLI when you use the --docker tag and finally, you can also control it via the webUI in the execution tab -> container -> image section

  
  
Posted one month ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , can you add a log of the execution?

  
  
Posted one month ago
140 Views
9 Answers
one month ago
one month ago
Tags