Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I Dont Know What Happened But I Am Unable To Download A Dataset I Used To Download To Cached Folder. Now, When I Try To Download, The Dataset Show The Following Error. Just Few Day Ago, I Still Can Download And Run With The Dataset Sucessfully. I

Hi all, I dont know what happened but I am unable to download a dataset I used to download to cached folder. Now, when I try to download, the dataset show the following error. Just few day ago, I still can download and run with the dataset sucessfully. I haven't tough or change the dataset. Anyone know why this happened?
image

  
  
Posted 9 months ago
Votes Newest

Answers 12


Might be worth running the command again with the --verbose flag. It will likely give more details on what is causing the failure

  
  
Posted 9 months ago

Looks like its a /mnt which might mean its a drive or something similar that was connected and may not be any more?

For something quick, if you create a new folder to put your dataset:
mkdir ./test_dataset_location
Then you can run your command with
CLEARML_CACHE_DIR='./test_dataset_location' clearml-data ... <your command here>

It will try to download into that folder

  
  
Posted 9 months ago

5 days ago, I still can run without downloading issue
image

  
  
Posted 9 months ago

When I run, it doesn't show much information
image

  
  
Posted 9 months ago

It happens, happy training 🚀

  
  
Posted 9 months ago

When down dataset using python code, it show a littile bit more information like this one
image

  
  
Posted 9 months ago

Also the error you are showing is inside the calculate_metrics.py

Is that a clear-ml lib or something custom

  
  
Posted 9 months ago

Hope you can get something to work 🤞

  
  
Posted 9 months ago

One option might be to delete the local copy of the dataset and try to re-download it. Perhaps something has gone wrong with the local copy?

  
  
Posted 9 months ago

@<1590152178218045440:profile|HarebrainedToad56> I just download to another folder and find it working. Then I return to recheck the state.json file of the original folder then I realize that the original folder has corrupted state.json file. I don't know why it happened. But after I deleted the state.json file, I can start to download to the cache folder again 🙇

  
  
Posted 9 months ago

@<1590152178218045440:profile|HarebrainedToad56> strange thing is that we downloaded the dataseet previously, but now, when I look at the local, there is no folder in the cache folder

calculate_metrics.py we just download the dataset, then we postprocess later
image

  
  
Posted 9 months ago

Thank you very much for your help

  
  
Posted 9 months ago
480 Views
12 Answers
9 months ago
9 months ago
Tags
Similar posts