Hi, AgitatedDove14 , host OS is Ubuntu, I connect there via ssh.
The docker compose is of version 2 (the one that uses "docker compose" instead of older "docker-compose").
I did not pass anything to or from docker manually, only used the commands according to the official guide for clearml-serving:
pip install clearml-serving
clearml-serving create --name deeplog-inference-test --project LogSentinel
git clone
nano .env # here I added my ClearML URLs and credentials
docker compose -f --env-file .env clearml-serving-triton-gpu.yml up -d
clearml-serving model add --endpoint deepl_query --engine triton --model-id 8df30222595543d3a3ac55c9e5e2fb15 --input-size 7 1 --input-type float32 --output-size 6 --output-type float32 --input-name layer_0 --output-name layer_99
The only thing I ever did to clearml-serving dockers afterwards was docker compose down
and up
again.
Also, I did also accidentally create multiple services via clearml-serving create --name <> --project <>
, and cannot get rid of them.
And they point to either the wrong model or to no model at all, as I have only one model seen via clearml-serving model list
- and that is a model created by my command above, and in webui they point to nothing or to extremely old another model file...