Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Have A Clearml Installed On A Standalone Server Running Our Company'S Customized Ubuntu Mod. I'M Experience Logging Failures, Due To What Seems Like A Failed Access To The Server. It Looks As If The Api Call Got Somehow "Intercepted", Which Crashed

Hi, I have a ClearML installed on a standalone server running our company's customized Ubuntu mod. I'm experience logging failures, due to what seems like a failed access to the server. It looks as if the API call got somehow "intercepted", which crashed my experiment. Below is the prefix of the stack trace (I'm also attaching the full version). Is there a way to resolve it, or at least to skip failed logging attempts (so as not to crash the entire run)?
2021-07-08 15:25:24,049 - clearml.log - WARNING - failed logging task to backend (1 lines, <400/0: events.add_batch (<HTML><HEAD> <TITLE>Request Error</TITLE> </HEAD> <BODY> <img width="128" height="63" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAQAAAAB+CAMAAAD88z9RAAACTFBMVEUAAADiABrjABrjABrjABriA .... </BODY></HTML> )>) Killed

  
  
Posted 3 years ago
pic
More
ZealousSeal58
0 × 1
Report
Votes Newest

Answers 3

The following sentence in the HTML seems to hint at a corrupted/bad request, which is why I approached you in the first place:

This could be caused by a misconfiguration, or possibly a malformed request.

The error popped up after the experiment has been running for while, which is strange..

  
  
Posted 3 years ago
pic
More
ZealousSeal58
0 × 1
Report

heh, yeah, I thought as much. I feels like something that a company admin might be able to assist with, but I'm not entirely sure. The HTML response appears to have been composed by our local ops team who created the Ubuntu mod. I'll try to approach them.

  
  
Posted 3 years ago
pic
More
ZealousSeal58
0 × 1
Report

Hi ZealousSeal58 , this is not possible using configuration. Since this is not a "top level" error (like a gateway error or connection error), it will be really difficult to distinguish from normal server responses and so even hacking the ClearML code for that will not be easy, and will certainly will not be stable.
Can't you find the hijacker? 🙂

  
  
Posted 3 years ago
pic
More
SuccessfulKoala55
0 × 1
Report
Write your answer
860 Views
3 Answers
3 years ago
one year ago
Tags
clearml