Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Try To Run Locally

Hi, I try to run locally clearml-server and clearml-serving to create inference endpoint that utilize Triton server. So far I had port issues so I changed clearml-serving-inference outbound port to 9090. But after that I get the following issue:

clearml-serving-triton        | Retrying (Retry(total=237, connect=237, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f02a2602250>: Failed to establish a new connection: [Errno 111] Connection refused')': /auth.login

Is there any best practices for running both services locally? What kind of configuration I suppose to do?
I already tried to set ~/clearml.conf with access_key and provide it in example.env but it didn't help. Maybe Ido something wrong with host:port configurations. Thanks!

  
  
Posted 2 years ago
Votes Newest

Answers 60


image

  
  
Posted 2 years ago

So edited ik accordance with yours

  
  
Posted 2 years ago

I haven't followed it so closely, but let me check

  
  
Posted 2 years ago

Hey i tried your docker-compose
After all the initial setup, clearml-serving-triton
clearml-serving-statistics
clearml-serving-inference, throw read time out error?

  
  
Posted 2 years ago

you should also use my example.env

  
  
Posted 2 years ago

It should also work with host IP and two docker compose files.
I'm not sure where to push a for a unified docker compose?

  
  
Posted 2 years ago

does it work for you?

  
  
Posted 2 years ago

I don't thing WEB_HOST is important, but what about FILE_HOST?
do I need to change it accordingly?

  
  
Posted 2 years ago

Okay this seems correct...
Can you share both yaml files (server & serving) and env file?

  
  
Posted 2 years ago

I changed port here:

clearml-serving-inference:
    image: allegroai/clearml-serving-inference:latest
    container_name: clearml-serving-inference
    restart: unless-stopped
    ports:
      - "9090:8080"
  
  
Posted 2 years ago

would IP help instead?

  
  
Posted 2 years ago

it suppose to have access_key and secret_key which should correspond to this file

  
  
Posted 2 years ago

except access_key of course, they should be yours

  
  
Posted 2 years ago

But I'm getting a timeout issue, when i docker-compose up 😢

  
  
Posted 2 years ago

yeah, I tried the following
None
but haven't managed yet to make it work

  
  
Posted 2 years ago

one docker-compose for all

  
  
Posted 2 years ago

Ignore the quotes I've tried with quotes itself first

  
  
Posted 2 years ago

I should not edit anything in clearml.conf right?

  
  
Posted 2 years ago

@<1523706266315132928:profile|DefiantHippopotamus88> seems like you are missing the ports 🙂

CLEARML_WEB_HOST="
"
CLEARML_API_HOST="
"
CLEARML_FILES_HOST="
"
  
  
Posted 2 years ago

serving

  
  
Posted 2 years ago

the way above works for me

  
  
Posted 2 years ago

I tried that, it didn't work. I was confused by the separate port parameter:

CLEARML_SERVING_PORT: ${CLEARML_SERVING_PORT:-8080}

which is only one port related in docker-compose-triton.yml
Can I test /auth.login somehow independently? Using curl or any other way. Which address does it suppose to have and which creds should I use?

  
  
Posted 2 years ago

seems true

root@9f6a74ab9a27:~/clearml# curl 

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<title>405 Method Not Allowed</title>
<h1>Method Not Allowed</h1>
<p>The method is not allowed for the requested URL.</p>
root@9f6a74ab9a27:~/clearml# curl 

curl: (7) Failed to connect to localhost port 8081: Connection refused
root@9f6a74ab9a27:~/clearml# 
  
  
Posted 2 years ago

yeah, ok
but it didn't

  
  
Posted 2 years ago

I'm on Ubuntu

  
  
Posted 2 years ago

maybe I'm missing something with credentials?

  
  
Posted 2 years ago

Yep this is fine

  
  
Posted 2 years ago

same thing

clearml-serving-inference     | Retrying (Retry(total=236, connect=236, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f899dc4e8b0>: Failed to establish a new connection: [Errno 111] Connection refused')': /auth.login
  
  
Posted 2 years ago

When i run this it says can't run multi containers

  
  
Posted 2 years ago

Now when i docker compose again

  
  
Posted 2 years ago