Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
VivaciousWalrus21
Moderator
1 Question, 6 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

6 × Eureka!
0 Votes
12 Answers
873 Views
0 Votes 12 Answers 873 Views
Hi guys, does anybody have the same issue like me? Is there any workaround? https://github.com/allegroai/clearml/issues/762
2 years ago
0 Hi Guys, Does Anybody Have The Same Issue Like Me? Is There Any Workaround?

Thanks Martin. I tried to rerun everything from scratch using continue_last_task=0 and looks like it helped a lot but not completely. You can see in attached screenshot that gaps in iteration axis are still a little bigger than expected. I’v rerun it two times.

2 years ago
0 Hi Guys, Does Anybody Have The Same Issue Like Me? Is There Any Workaround?

I tried it, but unfortunately, this way it only sets last iteration to 0 instead of using last iteration from TensorBoard and simply rewrites logs. Expected behaviour is that it reads last iteration correctly. At least it is stated in docs so.

2 years ago
0 Hi Guys, Does Anybody Have The Same Issue Like Me? Is There Any Workaround?

The question is — are there any workarounds to set last iteration to correct value. And preferably do it in a simple way (i.e. not setting it manually).

2 years ago
0 Hi Guys, Does Anybody Have The Same Issue Like Me? Is There Any Workaround?

Hi Martin, thanks for the response! Nope, setting initial iteration didn’t solve the problem.

2 years ago
0 Hi Guys, Does Anybody Have The Same Issue Like Me? Is There Any Workaround?

No, I don’t need last iteration set to zero. All I need is to ClearML correctly initialize it from TensorBoard (or from wherever it initializes it). When I train model, stop training and then resume it, ClearML instead of using last iteration doubles (I guess) it. And this can be seen in attached screenshot in GitHub issue.

2 years ago