TimelyPenguin76 As I remember, I’ve closed all dataset right after upload the data to ClearML-server
I’ll try to reproduce this scenario to confirm no problem occurs during the generation of these datasets
Hi GrittyKangaroo27
did you also closed the dataset?
Can you attach the commands with the order of all the datasets?
So the flow is:
`
clearml-data create --project "data example" --name "my dataset"
clearml-data add --files <list of files>
clearml-data upload
clearml-data close
clearml-data create --project "data example" --name "my dataset" --parents <first dataset id>
clearml-data sync --id <first dataset id> --folder <list of files>
... `