So the flow is:
clearml-data create --project "data example" --name "my dataset"
clearml-data add --files <list of files>
clearml-data create --project "data example" --name "my dataset" --parents <first dataset id>
clearml-data sync --id <first dataset id> --folder <list of files>
I’ll try to reproduce this scenario to confirm no problem occurs during the generation of these datasets
Yes, basically like this
did you also closed the dataset?
Can you attach the commands with the order of all the datasets?
TimelyPenguin76 As I remember, I’ve closed all dataset right after upload the data to ClearML-server