I mean I'm hosting it myself, it's on app.clear.ml

also, I see that clearml-serving support pytorch, is there any chance for support for TensorRT ?

Thanks for the reply ! I am using the enterprise version, do you have a link to some docs for the autoscaler ? On the orchestration tab I can see AWS and GCP but not Azure. (also, I was previously able to see Clearml GPUs, but it looks like they're not available anymore ?)

ah, okay that make sense, I'll look more into the difference between pro / enterprise. Thanks for the info !

Hi @<1644147961996775424:profile|HurtStarfish47> , to answer your questions:

• Is there an autoscaler available for Azure ?I'm afraid not in the self hosted version. An Azure autoscaler is available only in the Scale/Enterprise licenses.
• I'm interested in the clearml-serving functionnalities, would that be suitable for real-time inference on arm64 devices ?Yes 🙂

What is the address of your server?

Then it's the community server, that is not an enterprise version. In the PRO version only AWS/GCP autoscalers are available.