Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Is Is Intended That Restarting The Server Somestimes Leads To Abortion Of Experiments On Clearml-Agents

Is is intended that restarting the server somestimes leads to abortion of experiments on clearml-agents User aborted: stopping task (3) ?

Posted 2 years ago
Votes Newest

Answers 3

I don't think so. It is related to issue with the clearml-server I posted in the other thread. Essentially the clearml-server hangs, then I restart it with docker-compose down && docker-compose up -d and the experiments sometimes show as running, but on the clearml-agents I see that actually nothing is running or they show as aborted.
I know that usually clearml-agents do not abort on server restart and just continue.

Posted 2 years ago

ReassuredTiger98 this should not happen - are you sure this is not at the very start of the experiment?

Posted 2 years ago

I don't think this the intended behavior. Can you please elaborate how it happens exactly?

Posted 2 years ago
3 Answers
2 years ago
one year ago