Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I Dont Know What Happened But I Am Unable To Download A Dataset I Used To Download To Cached Folder. Now, When I Try To Download, The Dataset Show The Following Error. Just Few Day Ago, I Still Can Download And Run With The Dataset Sucessfully. I

Hi all, I dont know what happened but I am unable to download a dataset I used to download to cached folder. Now, when I try to download, the dataset show the following error. Just few day ago, I still can download and run with the dataset sucessfully. I haven't tough or change the dataset. Anyone know why this happened?
image

  
  
Posted one year ago
Votes Newest

Answers 12


Also the error you are showing is inside the calculate_metrics.py

Is that a clear-ml lib or something custom

  
  
Posted one year ago

@<1590152178218045440:profile|HarebrainedToad56> I just download to another folder and find it working. Then I return to recheck the state.json file of the original folder then I realize that the original folder has corrupted state.json file. I don't know why it happened. But after I deleted the state.json file, I can start to download to the cache folder again 🙇

  
  
Posted one year ago

It happens, happy training 🚀

  
  
Posted one year ago

Looks like its a /mnt which might mean its a drive or something similar that was connected and may not be any more?

For something quick, if you create a new folder to put your dataset:
mkdir ./test_dataset_location
Then you can run your command with
CLEARML_CACHE_DIR='./test_dataset_location' clearml-data ... <your command here>

It will try to download into that folder

  
  
Posted one year ago

When I run, it doesn't show much information
image

  
  
Posted one year ago

Might be worth running the command again with the --verbose flag. It will likely give more details on what is causing the failure

  
  
Posted one year ago

5 days ago, I still can run without downloading issue
image

  
  
Posted one year ago

@<1590152178218045440:profile|HarebrainedToad56> strange thing is that we downloaded the dataseet previously, but now, when I look at the local, there is no folder in the cache folder

calculate_metrics.py we just download the dataset, then we postprocess later
image

  
  
Posted one year ago

When down dataset using python code, it show a littile bit more information like this one
image

  
  
Posted one year ago

Hope you can get something to work 🤞

  
  
Posted one year ago

One option might be to delete the local copy of the dataset and try to re-download it. Perhaps something has gone wrong with the local copy?

  
  
Posted one year ago

Thank you very much for your help

  
  
Posted one year ago
616 Views
12 Answers
one year ago
one year ago
Tags
Similar posts