Hello! I’m currently using ClearML-Server as an artifact manager and ClearML-Serving for model inference, with each running on separate hosts using Docker Compose. I’ve successfully deployed a real-time inference model in ClearML-Serving, configured within its own container. Now, I need to deploy another model that requires a different environment in the same ClearML-Serving setup.
Is it possible to configure Docker Compose to run two different models in their own containers, and if so, how can ClearML-Serving be configured to direct requests to the appropriate container based on the service endpoint? I’m also interested in monitoring both models using a single Grafana dashboard. I came across a tutorial suggesting this might be possible, but I’m unsure how to implement it so that ClearML-Serving correctly routes traffic to the right container for predictions. Any advice or insights on this setup would be greatly appreciated!