its a directory (sha generation step actually successfull:
Generating SHA2 hash for 1136604 files
as in github issue). given previous experience, i would expect it to be uploaded as multiple zip files.
yes, I dont use s3. i have a dedicated machine with raid configured, were clearml server is running.
I am not sure about that. I have another dataset of similar structure which is smaller (40gb) and which succeeded to be uploaded. Seems like the how it works - first it computes sha for all the files, but during uploading - aggregates small files in to zip archives approx 512 mb each.