Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey. This May Be A Silly Question ... But I Am Unsure About How The

Hey. This may be a silly question ... but I am unsure about how the clearml-agent works. Does it need to be installed on the local server (from which the experiments are initialised and defined) or does it need to be installed on the remote? Or maybe even both?

  
  
Posted 3 years ago
Votes Newest

Answers 6


Hi TenseOstrich47
You can also check this video out on our youtube channel:
https://youtu.be/gPBuqYx_c6k
It's still branded as trains (our old brand) but it applies to clearml just the same!

  
  
Posted 3 years ago

Hi TenseOstrich47 ,
ClearML Agent is meant to be installed on the remote machine.
The experiment is usually initialized and defined by the experiment code, running locally on your machine - once you run this experiment (call it your "template", and you don't have to run it through, just let it start running and do an iteration or two 🙂 ), it appears in the WebApp, where you can clone it (which creates a new draft experiment, identical to the template experiment), and enqueue the new clone experiment in a queue . ClearML Agent should run on a remote machine and listen on this queue (and possibly other queues as well). Once the experiment is queued, ClearML Agent will take it from the queue, initialize a suitable running environment for this experiment on the remote machine and execute it.
This is the process in general (without all kinds of small details and various options 🙂 )
Does that answer your question?

  
  
Posted 3 years ago

Yes it does 🙂 I suspected this was the process. Thanks Jake. One last question, more so about the architecture design - is it advised to have the clearml server instance and a 'worker' instance listening to the queue as separate remote machines, or can I use the same instance for the web UI and and as a worker? I understand that processing pipelines may be compute intense enough to consume all resources and break the web UI, but I was wondering whether using a single large instance is a possibility at all?

  
  
Posted 3 years ago

Well, it's certainly possible, although I haven't tried it myself. Usually, your experiments require a GPU, and that's not something you need in the machine running the Server.
To sum up, it's possible, but in reality if you have a semi-decent non-GPU machine with 16GB of memory, you can just run the server there and forget about it 🙂

  
  
Posted 3 years ago

Awesome, thank you Jake! very helpful. For a lot of the models we run, we do not require GPU resources, so its good to know that a beefy instance should be able to run the experiments.

  
  
Posted 3 years ago

Thanks AnxiousSeal95 , will check it out! 🙂

  
  
Posted 3 years ago
508 Views
6 Answers
3 years ago
one year ago
Tags