@<1590152178218045440:profile|HarebrainedToad56> I just download to another folder and find it working. Then I return to recheck the state.json file of the original folder then I realize that the original folder has corrupted state.json file. I don't know why it happened. But after I deleted the state.json file, I can start to download to the cache folder again 🙇
Hope you can get something to work 🤞
Looks like its a /mnt
which might mean its a drive or something similar that was connected and may not be any more?
For something quick, if you create a new folder to put your dataset:mkdir ./test_dataset_location
Then you can run your command withCLEARML_CACHE_DIR='./test_dataset_location' clearml-data ... <your command here>
It will try to download into that folder
@<1590152178218045440:profile|HarebrainedToad56> strange thing is that we downloaded the dataseet previously, but now, when I look at the local, there is no folder in the cache folder
calculate_metrics.py
we just download the dataset, then we postprocess later
Also the error you are showing is inside the calculate_metrics.py
Is that a clear-ml lib or something custom
One option might be to delete the local copy of the dataset and try to re-download it. Perhaps something has gone wrong with the local copy?
When down dataset using python code, it show a littile bit more information like this one
When I run, it doesn't show much information
Might be worth running the command again with the --verbose
flag. It will likely give more details on what is causing the failure
5 days ago, I still can run without downloading issue