@<1523701205467926528:profile|AgitatedDove14> Also could you please share the commit to fix the issue? It'll help to address it on our end.
Thanks!
Yes I'm sure that the Triton container finished syncing.
here is the Triton logs:
I0223 15:58:32.515979 71 model_repository_manager.cc:1352] successfully loaded 'yolo_2' version 1
I0223 15:58:32.842511 71 model_repository_manager.cc:1352] successfully loaded 'yolo_1' version 1
I0223 15:58:32.842579 71 server.cc:559]
+------------------+------+
| Repository Agent | Path |
+------------------+------+
+------------------+------+
I0223 15:58:32.842606 71 server.cc:586]
+-------------+---...in the clearml.conf we put this:
http {
timeout {
total: 300
}
}
is that correct?
Also I can’t call the “preprocess” function since there is no valid endpoint to be hitting
and here is the serving inference logs:
ffmpeg version 4.3.6-0+deb11u1 Copyright (c) 2000-2023 the FFmpeg developers
built with gcc 10 (Debian 10.2.1-6)
configuration: --prefix=/usr --extra-version=0+deb11u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-...Thank you for your prompt response. As I installed ClearML using pip, I don't have direct access to the config file. Is there any other way to increase this timeout?
Sure,
clearml-serving --id $SERVING_ID model add \
--name "yolo" --version 2 --project $PROJECT_NAME --engine triton --endpoint "yolov8" \
--preprocess "./yolo/preprocess.py" \
--input-size 3 -1 -1 --input-name "images" --input-type float32 \
--output-size -1 -1 --output-name "output0" --output-type float32 \
--aux-config ./yolo/config.pbtxt
I'm using the latest version of clearml-serving
Name: clearml-serving
Version: 1.3.0