Hello Everyone,
I am trying to deploy a model in vLLM Model Deployment, I am using TinyLlama/TinyLlama-1.1B-Chat-v1.0, it is already an hour it started deploying, still it is loading, will it take more time? Or do I need to add something to the configuration? Please give your inputs.
Hi SuccessfulPigeon84 , what do you see in the log?
ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
2025-04-07 10:25:28
ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start
