Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Have A Problem With "Dataset" Module. I Create Dataset And Uploaded Few Files:

Hi, I have a problem with "Dataset" module.
I create dataset and uploaded few files:
files_root='/tmp' dataset = Dataset.create(dataset_name='2022', dataset_project='Test') dataset.add_files(path=f"{files_root}/202201.csv") dataset.add_files(path=f"{files_root}/202202.csv") dataset.add_files(path=f"{files_root}/202203.csv") dataset.upload() dataset.finalize()Now I want to create child dataset.
dataset2 = Dataset.create(dataset_name='2022', dataset_project='Test', dataset_version='2.0.0', parent_datasets=['aa3e601a405c4b67a6d96ee82363a0d2'] ) dataset2.add_files(path=f"{files_root}/202204.csv") dataset2.upload()But then error occurs:
Uploading dataset changes (1 files compressed to 1.63 MiB) to File compression and upload completed: total size 1.63 MiB, 1 chunked stored (average size 1.63 MiB) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/vscode/.local/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 698, in upload self._ds_total_size_compressed = total_size + self._get_total_size_compressed_parents() File "/home/vscode/.local/lib/python3.8/site-packages/clearml/datasets/dataset.py", line 1206, in _get_total_size_compressed_parents compressed_size += runtime_task.runtime.get("ds_total_size_compressed", 0) TypeError: unsupported operand type(s) for +=: 'int' and 'NoneType'My environment:
` clearml 1.6.2

ClearmlServer:
WebApp: 1.6.0-213 • Server: 1.6.0-213 • API: 2.20 `

  
  
Posted one year ago
Votes Newest

Answers 5


Hmm HandsomeGiraffe70
This seem like a bug, let me see what we can do about that 🙂
could it be the parent version was created with an older version of clearml sdk ?

  
  
Posted one year ago

After upgrade to the newest version I had to recreate all datasets to be working in new Dataset view in GUI. So all dataset are fresh :)

  
  
Posted one year ago

Guys, it looks like my bad. I wanted to recreate the issue again and its working. I had to have a mess in my current session.
So good news, thats not a bug 🙂
Anyway, thanks for you time.

  
  
Posted one year ago

Hmm this is odd, when you press on the parent dataset in the UI, and go to full-details, then the INFO tab. Can you copy here everything ?

  
  
Posted one year ago

👍 no worries

  
  
Posted one year ago
714 Views
5 Answers
one year ago
one year ago
Tags
Similar posts