Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Re-Create/Upload From Disk A Final Dataset? One Dataset Part Is Corrupted On Disk At The File Server And Cannot Longer Be Downloaded. Thanks In Advance!

Hi. I am using ClearML server on premises to manage ML data and tasks/experiments. Is it possible to re-create/upload from disk a FINAL dataset? One dataset part is corrupted on disk at the File Server and cannot longer be downloaded. Thanks in advance!

  
  
Posted one month ago
Votes Newest

Answers 4


Hi @<1751777178984386560:profile|ConfusedGoat3> , is the data itself still accessible anywhere in it's entirety?

  
  
Posted one month ago

Hi @<1523701070390366208:profile|CostlyOstrich36> . It seems at least one artifact from the dataset task (i.e., a .zip part) is damaged on disk. I can access both the File Server storage and I do have a separate copy of the dataset outside ClearML that I could use to re-create/upload from disk. Do you know if there is a way to re-create/upload from disk using the backup copy I have outside ClearML? Thanks a lot in advance for your support!

  
  
Posted one month ago

Thanks again, @<1523701070390366208:profile|CostlyOstrich36> . I understand, but the copy is not a backup of ClearML .zip parts rather a single .zip file. Is there a way to re-create/upload from disk ClearML .zip parts? For example, trying to split the single .zip using ClearML .zip parts size? Could the HASH be an issue? Can dataset 'synchronize' help in this case?

  
  
Posted one month ago

ClearML only keeps links to the data, so if you simply put the copy you have in the same paths, everything will work as before

  
  
Posted one month ago
91 Views
4 Answers
one month ago
one month ago
Tags