Hello, Question About The Time Of Upload: Is It Faster Or Exactly The Same To Upload 1 File Of 1Gb Compared To 10 Files Of 100 Mb?

Answered

Hello,

Question about the time of upload:
Is it faster or exactly the same to upload 1 file of 1Gb compared to 10 files of 100 Mb?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulRaven86
				
					0
					 × 1

Votes Newest

Answers 3

For now, I am uploading to the basic-available ClearML server to store my data. But I will soon use S3 buckets to store data. So the question is for both use cases 🙂

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulRaven86
				
					0
					 × 1

When using S3, I think boto3 (which is used under the hood), will use multipart uploads, so I'd say stick to the large file

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Hi @<1556812486840160256:profile|SuccessfulRaven86> , are you uploading to a self-hosted server?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Write your answer

1K Views

3 Answers

one year ago