Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Have This Issue With Clearml Datasets. Do You Know Hot To Solve It?

Hi, I have this issue with clearml datasets. Do you know hot to solve it?
(vslam38) quetalasj@quetalasj-Swift-SF514-51:~/PycharmProjects/vslam-experiment$ clearml-data list --id 691ee1ae04b54af397cb12fdf94fa955 clearml-data - Dataset Management & Versioning CLI List dataset content: 691ee1ae04b54af397cb12fdf94fa955 2021-09-09 18:15:21,276 - clearml.storage - ERROR - Could not download ` , err: [Errno 13] Permission denied: '/home/quetalasj/.clearml/cache/storage_manager/datasets/4ea0d4bf09d397c5b0d49df5d0289db6.state.json_1631200520.8221598.partially'

Error: Could not load Dataset id=691ee1ae04b54af397cb12fdf94fa955 state `

  
  
Posted 3 years ago
Votes Newest

Answers 5


dataset with this id exists but I cannot get access to any dataset on the server from my PC.
Also, I cannot download it with such error.
2021-09-08 19:06:27,495 - clearml.storage - INFO - Downloading: 745.00MB / 751.71MB @ 3.08MBs from 2021-09-08 19:06:29,183 - clearml.storage - INFO - Downloading: 750.00MB / 751.71MB @ 2.96MBs from 2021-09-08 19:06:29,348 - clearml.storage - INFO - Downloaded 751.71 MB successfully from , saved to /clearml_agent_cache/storage_manager/datasets/0f647571a1988bd2e19739fbc99ffd1c.dataset.361610c029794b36a6cc6c1027900a28.zip 2021-09-08 19:07:42 2021-09-08 19:07:40,080 - clearml.storage - ERROR - Could not download , err: HTTPConnectionPool(host='robo.skoltech.ru', port=8081): Max retries exceeded with url: /datasets/kitti_ground_truth.01f45aee71cc41e2b718a15a0c02b65b/artifacts/state/state.json (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6740acea00>: Failed to establish a new connection: [Errno -2] Name or service not known')) Traceback (most recent call last): File "/root/.clearml/venvs-builds/3.9/task_repository/vslam-experiment/main.py", line 24, in <module> experiment.run_experiment() File "/root/.clearml/venvs-builds/3.9/task_repository/vslam-experiment/vslam_experiment/vslam_experiment.py", line 21, in run_experiment self._dataset.download() File "/root/.clearml/venvs-builds/3.9/task_repository/vslam-experiment/vslam_experiment/datataset/clearml_dataset.py", line 12, in download self._dataset_root_path = clearml.Dataset.get(dataset_project=self._project_name, File "/root/.clearml/venvs-builds/3.9/lib/python3.9/site-packages/clearml/datasets/dataset.py", line 468, in get_local_copy target_folder = self._merge_datasets(use_soft_links=use_soft_links, raise_on_error=raise_on_error) File "/root/.clearml/venvs-builds/3.9/lib/python3.9/site-packages/clearml/datasets/dataset.py", line 1141, in _merge_datasets ds = Dataset.get(dataset_id=dataset_version_id) File "/root/.clearml/venvs-builds/3.9/lib/python3.9/site-packages/clearml/datasets/dataset.py", line 835, in get raise ValueError('Could not load Dataset id={} state'.format(task.id)) ValueError: Could not load Dataset id=01f45aee71cc41e2b718a15a0c02b65b state 2021-09-08 19:07:42 Process failed, exit code 1

  
  
Posted 3 years ago

Hi LazyFish41
Could it be some permission issue on /home/quetalasj/.clearml/cache/ ?

  
  
Posted 3 years ago

AgitatedDove14 Yes, Thank you!
This command solves the problem:
sudo chmod -R 777 /home/quetalasj/.clearml/cache/storage_manager/datasets/

  
  
Posted 3 years ago

root somehow was the owner of the directory

  
  
Posted 3 years ago

Yep that is it 🙂

  
  
Posted 3 years ago
925 Views
5 Answers
3 years ago
one year ago
Tags