I mean I'm hosting it myself, it's on app.clear.ml

What is the address of your server?

Thanks for the reply ! I am using the enterprise version, do you have a link to some docs for the autoscaler ? On the orchestration tab I can see AWS and GCP but not Azure. (also, I was previously able to see Clearml GPUs, but it looks like they're not available anymore ?)

Then it's the community server, that is not an enterprise version. In the PRO version only AWS/GCP autoscalers are available.

also, I see that clearml-serving support pytorch, is there any chance for support for TensorRT ?

ah, okay that make sense, I'll look more into the difference between pro / enterprise. Thanks for the info !

Hi @<1644147961996775424:profile|HurtStarfish47> , to answer your questions:

• Is there an autoscaler available for Azure ?I'm afraid not in the self hosted version. An Azure autoscaler is available only in the Scale/Enterprise licenses.
• I'm interested in the clearml-serving functionnalities, would that be suitable for real-time inference on arm64 devices ?Yes 🙂