Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Can I Run A Single Hyperparameter Optimization Task With At Least 100 Experiments On Multiple Machines By Using Clearml-Agent And Queue?

Hi,
can I run a single hyperparameter optimization task with at least 100 experiments on multiple machines by using clearml-agent and queue?

  
  
Posted 4 months ago
Votes Newest

Answers 9


You can add torch to the installed packages section manually to get it running but I'm curious why it wasn't logged. How did you create the original experiment?

  
  
Posted 4 months ago

Did you run the code locally first? I don't see the agent installing the packages themselves, did you remove it from the log or how are the packages being installed?

  
  
Posted 4 months ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , yes you can 🙂

  
  
Posted 4 months ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , can you add a log of the execution?

  
  
Posted 4 months ago

@<1523701070390366208:profile|CostlyOstrich36> I keep failing to execute the task with clearml-agent because of environment setting.. How could I adjust clearml.conf file for the agent to use specific local environment?

  
  
Posted 4 months ago

@<1523701070390366208:profile|CostlyOstrich36>
My code is supposed to automatically clone a optimization task with template_task_id and execute each experiment. I didn't remove any lines from the logs.
When I run the code locally, I run it with a virtual environment activated. However, if I use clearml-agent daemon to execute the task, it seems like using a default docker image, and I don't know how to change the corresponding settings in the clearml.conf file!

  
  
Posted 4 months ago

Hi @<1664079296102141952:profile|DangerousStarfish38> , you can control it in the agent.default_docker.image section of the clearml.conf where the agent is running. You can also control it via the CLI when you use the --docker tag and finally, you can also control it via the webUI in the execution tab -> container -> image section

  
  
Posted 4 months ago

@<1523701070390366208:profile|CostlyOstrich36> Would you mind looking over this issue?

  
  
Posted 4 months ago

But it looks like you aren't running the agent in docker mode, at least from the log you provided . You need to add the --docker tag to the command when you run it

  
  
Posted 4 months ago
384 Views
9 Answers
4 months ago
4 months ago
Tags