Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Clearml.Backend_Interface.Session.Senderror: Action Failed <500/100: Tasks.Enqueue/V1.0 (General Data Error (Connectionerror(<Urllib3.Connection.Httpconnection Object At 0X7F28607096D8>: Failed To Establish A New Connection: [Errno 111] Connection Refused

clearml.backend_interface.session.SendError: Action failed <500/100: tasks.enqueue/v1.0 (General data error (ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f28607096d8>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f28607096d8>: Failed to establish a new connection: [Errno 111] Connection refused)))> (queue=7563b320bfcd4b7aa71548ecafb7ed3c, task=f4ae919ada264b1685cc37be818780f6) ,I saw exceptions on elastic container but after restart it still stuck, someone can help?

  
  
Posted one year ago
Votes Newest

Answers 12


@<1539780272512307200:profile|GaudyPig83> screenshots are really hard to follow - can you attach the entire log as a text file?
Also, clearml.backend_interface.session.SendError: Action failed <500/100: tasks.enqueue/v1.0... is not from the ES container - where did you get this error?

  
  
Posted one year ago

{"type": "server", "timestamp": "2023-02-23T17:28:53,998Z", "level": "ERROR", "component": "i.n.u.c.D.rejectedExecution", "cluster.name": "clearml", "node.name": "clearml", "message": "Failed to submit a listener notification task. Event loop shut down?", "cluster.uuid": "MaYOStbNR6awAlPgDz2r5A", "node.id": "Nr-Cs0Y_S1642J-xn17I-g" ,

  
  
Posted one year ago

Hey @<1539780272512307200:profile|GaudyPig83> !

Are you running a self-hosted server? Is this the only type of HTTP call that fails or does e.g. logging experiments also not work? A connection error usually means your docker containers can't reach each other.

  
  
Posted one year ago

I'm sorry, but I will need more context. Where exactly is this log from? Can you confirm you're working with a self-hosted open source server? Which container/microservices is giving you this last error message?

  
  
Posted one year ago

hi this error is from the elastic container

  
  
Posted one year ago

other container logs look working correctlly

  
  
Posted one year ago

@<1539780272512307200:profile|GaudyPig83> the containers seem fine - where was the original error you posted taken from? it looks like it's from a clearml task log

  
  
Posted one year ago

You will have to provide more information. What other docker containers are running and how did you start the server?

  
  
Posted one year ago

image

  
  
Posted one year ago

image

  
  
Posted one year ago

the container upload when mechine is up

  
  
Posted one year ago

the 500 error is result from task view

  
  
Posted one year ago
954 Views
12 Answers
one year ago
one year ago
Tags