Unanswered
Does Dataset.Add_Files Support Uploading From S3 Uri?
I Have No Problem Uploading To S3 But Cant Use Data That Is Already In S3?
Or Am I Dong Something Wrong? I Read In Documentation That Add_External_Files Supports This Feature, But I Want To Be Able To
Our datasets are more than 1TB in size and will grow in size (probably 4TB and up), this means we also need 4TB local storage
Yes, because somewhere you will have to store your unzipped files.
Or you point to the S3 bucket, and fetch the data when you need to access it (ore prefetch it) with the S3 links the Dataset stores, i.e. only when accessed
95 Views
0
Answers
7 months ago
7 months ago