In my understanding requests still go through clearml-server which configuration I left intact. Maybe due to the port change in clearml-serving I need to adjust smth.

curl -X POST " " -H "accept: application/json" -H "Content-Type: application/json" -d '{"url": " "}' curl: (56) Recv failure: Connection reset by peer

CLEARML_FILES_HOST=" "

Let's maybe join our effort to get local deployment?

at least no more auth errors

like None ?

does it work for you?

yeah, ok
but it didn't

I got only smth like this:

clearml-serving-triton        | I0701 08:32:58.580705 46 server.cc:250] Waiting for in-flight requests to complete.
clearml-serving-triton        | I0701 08:32:58.580710 46 server.cc:266] Timeout 30: Found 0 model versions that have in-flight inferences
clearml-serving-triton        | I0701 08:32:58.580713 46 server.cc:281] All models are stopped, unloading models
clearml-serving-triton        | I0701 08:32:58.580717 46 server.cc:288] Timeout 30: Found 0 live ...

I haven't followed it so closely, but let me check

can you share your log items?

I'm on Ubuntu

except access_key of course, they should be yours

you should also use my example.env

how d you start a docker-compose?

docker-compose --env-file example.env -f docker-compose.yml up -d

curl -X POST " " -H "accept: application/json" -H "Content-Type: application/json" -d '{"url": " "}' {"detail":"Error processing request: Error: Failed loading preprocess code for 'py_code_test_model_pytorch2': 'NoneType' object has no attribute 'loader'"}

it suppose to have access_key and secret_key which should correspond to this file

but it actually looks ok

that's strange, maybe you should upgrade it

I can make a PR if it works

the way above works for me

it worked for me with one docker-compose for all

I made it working with full port reassignment to 9090 in clearml-serving-inference
which still send me an error that the format of my request is somehow wrong
but then I started from scratch by creating completely new project and new endpoint

I have to step away for a couple of hours
please let me know if you find something wrong

maybe I'm missing something with credentials?

same thing

clearml-serving-inference     | Retrying (Retry(total=236, connect=236, read=240, redirect=240, status=240)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f899dc4e8b0>: Failed to establish a new connection: [Errno 111] Connection refused')': /auth.login

server

serving

will continue tomorrow

doesn't work anyway