Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi!

Hi!
(Context) I'm currently working on a project with OpenMMLab (MMDetection) in Docker and I'm trying to train a detection model remotely on ClearML. I've already been able to train an MMDetection model locally on a custom dataset fetched from ClearML (through a 'before_runner' hook in training) and in a docker container.
( Question ) I'm wondering what the possibilities are here for remote training with ClearML through Docker. Is it possible to run an entire docker container from a predefined docker image as a ClearML task (so that it's added to the queue like any other task)? Or is it possible to train remotely using hooks in my MMDetection pipeline? Any other suggestion or possibilities? Best practices? I have very limited experience with Docker, ClearML and OpenMMLab. Thanks in advance!

  
  
Posted one month ago
Votes Newest

Answers 2


Hi @<1856869648880898048:profile|CourageousFly32> ,

Is it possible to run an entire docker container from a predefined docker image as a ClearML task (so that it's added to the queue like any other task)?

Yes. You can use the --docker flag in clearml-agent to make it run in agent mode - None

Or is it possible to train remotely using hooks in my MMDetection pipeline?

Can you elaborate?

Any other suggestion or possibilities? Best practices? I have very limited experience with Docker, ClearML and OpenMMLab. Thanks in advance!

I would suggest getting familiarized with Docker concepts and OpenMMLab first. ClearML adds capabilities on top and allows you to manipulate them better.

  
  
Posted one month ago

Hi thank you for your reply! As for the hooks: when running the openmmlab training script the runner goes through some predefined functions, and by using hooks at certain 'mounting point' in the runner's workflow you can add some custom code to the training script. So I was thinking it might be possible to write a hook that initializes the clearml task at the beginning of the script and then calls execute_remotely(...) so the training is happening remotely. Anyhow, I'll look into the docker options of the clearml agent first. Thanks!

  
  
Posted one month ago
237 Views
2 Answers
one month ago
one month ago
Tags
Similar posts