I have a dataset of ~24GB and I've tried multiple times uploading it with the sync function.

• The cache doesn't work, it attempts to download the dataset every time.
• It "misses" some files somehow. So once the job runs it fails due to missing files.
• I've ran verify afterwards (from the machine I used to upload the data) and it says it's all good. However, once I inspect the zip files on the server (look for the files in the specific zip the state json says they're in) the files are indeed missing.