Did you get the same as well?

do I need to change anything else?

Hi DefiantHippopotamus88
The idea is that clearml-server acts as a control plane and can sit on a different machine, obviously you can run both on the same machine for testing. Specifically it looks like the clearml-sering is not configured correctly as the error points to issue with initial handshake/login between the triton containers and the clearml-server. How did you configure the clearml-serving docker compose?

how d you start a docker-compose?

docker-compose --env-file example.env -f docker-compose.yml up -d

But I'm getting a timeout issue, when i docker-compose up 😢

my clearml.conf

api { 
    web_server: 

    api_server: 

    files_server: 

    # test 3
    credentials {
        "access_key" = "91SFEX4BYUQ9YCZ9V6WP"
        "secret_key" = "4WTXT7tAW3R6tnSi8hzSKNjgkmgUoyv22lYT2FIzIfLoeGERRO"
    }
}

serving

Hey i tried your docker-compose
After all the initial setup, clearml-serving-triton
clearml-serving-statistics
clearml-serving-inference, throw read time out error?

I'm on Ubuntu

I haven't followed it so closely, but let me check

DefiantHippopotamus88 seems like you are missing the ports 🙂

CLEARML_WEB_HOST="

"
CLEARML_API_HOST="

"
CLEARML_FILES_HOST="

"

Try the following example.env :

CLEARML_SERVING_PORT=9090
CLEARML_WEB_HOST="http://<IP>:8080"
CLEARML_API_HOST="http://<IP>:8008"
CLEARML_FILES_HOST="http://<IP>:8081"

(I think the localhost is resolved to inside the container and not the host machine, hence the error)

seems like an issue about 2 compose apps using different networks which are not accessible from each other
I wonder if I just need to join 2 docker-compose files to run everything in one session

I should not edit anything in clearml.conf right?

one docker-compose for all

I changed port here:

clearml-serving-inference:
    image: allegroai/clearml-serving-inference:latest
    container_name: clearml-serving-inference
    restart: unless-stopped
    ports:
      - "9090:8080"

So edited ik accordance with yours

will continue tomorrow

Ignore the quotes I've tried with quotes itself first

I can make a PR if it works

Yep this is fine

you are right, for some reason it doesn't resolve inside a container

root@dd0252a8f93e:~/clearml# curl 

curl: (7) Failed to connect to localhost port 8008: Connection refused
root@dd0252a8f93e:~/clearml# curl 

curl: (7) Failed to connect to 127.0.0.1 port 8008: Connection refused
root@dd0252a8f93e:~/clearml# 

yeah, I tried the following
None
but haven't managed yet to make it work

What are you getting with:

curl http://<ip>:8008/auth.login

but it actually looks ok

yeah, ok
but it didn't

Okay this seems correct...
Can you share both yaml files (server & serving) and env file?

No i use
docker compose instead of docker-compose

server