I’ll try to reproduce this scenario to confirm no problem occurs during the generation of these datasets

Yes, basically like this

So the flow is:

`
clearml-data create --project "data example" --name "my dataset"
clearml-data add --files <list of files>
clearml-data upload
clearml-data close

clearml-data create --project "data example" --name "my dataset" --parents <first dataset id>
clearml-data sync --id <first dataset id> --folder <list of files>
... `

TimelyPenguin76 As I remember, I’ve closed all dataset right after upload the data to ClearML-server

Hi GrittyKangaroo27

did you also closed the dataset?
Can you attach the commands with the order of all the datasets?