Someone can help with a problem with a dataset cache download? All my workers are download the ds every time that my simulation starts. It's not using the cache and always download it again. I have check the config is fine, the cache dir is fine, the files are there after download. But If I run again, it downloads again.
dataset = Dataset.get(dataset_id=dataset_id, dataset_version="1.0.12")
print("Found dataset:", dataset.name, "version:", dataset.version)
local_path = dataset.get_local_copy()
Hi @<1523701070390366208:profile|CostlyOstrich36> , I just discovered that was some kind of dataset error on files or checksum that was always saying that the data need to be downloaded again.
I have created another dataset and now it's fine. Thank you.
Hi @<1820993257639776256:profile|DeepOwl31> , are all workers on the same machine?
