I’ll try to reproduce this scenario to confirm no problem occurs during the generation of these datasets

Hi GrittyKangaroo27

did you also closed the dataset?
Can you attach the commands with the order of all the datasets?

TimelyPenguin76 As I remember, I’ve closed all dataset right after upload the data to ClearML-server

Yes, basically like this

So the flow is:

`
clearml-data create --project "data example" --name "my dataset"
clearml-data add --files <list of files>
clearml-data upload
clearml-data close

clearml-data create --project "data example" --name "my dataset" --parents <first dataset id>
clearml-data sync --id <first dataset id> --folder <list of files>
... `