Hello Everyone, I Am Trying To Deploy A Model In Vllm Model Deployment, I Am Using Tinyllama/Tinyllama-1.1B-Chat-V1.0, It Is Already An Hour It Started Deploying, Still It Is Loading, Will It Take More Time? Or Do I Need To Add Something To The Configurat

Answered

Hello Everyone,
I am trying to deploy a model in vLLM Model Deployment, I am using TinyLlama/TinyLlama-1.1B-Chat-v1.0, it is already an hour it started deploying, still it is loading, will it take more time? Or do I need to add something to the configuration? Please give your inputs.

  				
Posted 
	13 days ago

					More  		
  Report
		
					SuccessfulPigeon84
				
					0
					 × 1

Votes Newest

Answers 7

CostlyOstrich36

  				
Posted 
	13 days ago

					More  		
  Report
		
					SuccessfulPigeon84
				
					0
					 × 1

CostlyOstrich36

  				
Posted 
	13 days ago

					More  		
  Report
		
					SuccessfulPigeon84
				
					0
					 × 1

okay

  				
Posted 
	13 days ago

					More  		
  Report
		
					SuccessfulPigeon84
				
					0
					 × 1

ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
2025-04-07 10:25:28
ClearML Monitor: Could not detect iteration reporting, falling back to iterations as seconds-from-start

  				
Posted 
	13 days ago

					More  		
  Report
		
					SuccessfulPigeon84
				
					0
					 × 1

Can you provide the full log?

  				
Posted 
	13 days ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Hi SuccessfulPigeon84 , what do you see in the log?

  				
Posted 
	13 days ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

I did sent the logs to you in private

  				
Posted 
	13 days ago

					More  		
  Report
		
					SuccessfulPigeon84
				
					0
					 × 1

Write your answer

53 Views

7 Answers

13 days ago