hi @<1727497172041076736:profile|TightSheep99>
yes, but also set the dataset chunk filesize to something smaller than the default 500Gb (--chunk-size)
None
ok thank you! I'll update this thread when I test it
Hey guys, if I set file_upload_retries arbitrarily high like 1000, should I be good to upload a large dataset >1GB on spotty connections?
hi @<1727497172041076736:profile|TightSheep99>
yes, but also set the dataset chunk filesize to something smaller than the default 500Gb (--chunk-size)
None
ok thank you! I'll update this thread when I test it