Unanswered
Does Dataset.Add_Files Support Uploading From S3 Uri?
I Have No Problem Uploading To S3 But Cant Use Data That Is Already In S3?
Or Am I Dong Something Wrong? I Read In Documentation That Add_External_Files Supports This Feature, But I Want To Be Able To
Yes, but does add_external_files makes chunked zips as add_files do?
No it references them, (i.e. meta-data not actually doing something with the files themselves)
I need the zipping, chunking to manage millions of files
That makes sens, if that's the case you will have to download those files anyway, and then add them with add_files
you can use the StoargeManager to download them, and then add them from the local copy (this will zip/chunk them)
None
96 Views
0
Answers
8 months ago
8 months ago