Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi. I Am Using Clearml Server On Premises To Manage Ml Data And Tasks/Experiments. Is It Possible To Re-Create/Upload From Disk A Final Dataset? One Dataset Part Is Corrupted On Disk At The File Server And Cannot Longer Be Downloaded. Thanks In Advance!

Hi. I am using ClearML server on premises to manage ML data and tasks/experiments. Is it possible to re-create/upload from disk a FINAL dataset? One dataset part is corrupted on disk at the File Server and cannot longer be downloaded. Thanks in advance!

  
  
Posted 7 days ago
Votes Newest

Answers 4


Hi @<1523701070390366208:profile|CostlyOstrich36> . It seems at least one artifact from the dataset task (i.e., a .zip part) is damaged on disk. I can access both the File Server storage and I do have a separate copy of the dataset outside ClearML that I could use to re-create/upload from disk. Do you know if there is a way to re-create/upload from disk using the backup copy I have outside ClearML? Thanks a lot in advance for your support!

  
  
Posted 7 days ago

Thanks again, @<1523701070390366208:profile|CostlyOstrich36> . I understand, but the copy is not a backup of ClearML .zip parts rather a single .zip file. Is there a way to re-create/upload from disk ClearML .zip parts? For example, trying to split the single .zip using ClearML .zip parts size? Could the HASH be an issue? Can dataset 'synchronize' help in this case?

  
  
Posted 5 days ago

ClearML only keeps links to the data, so if you simply put the copy you have in the same paths, everything will work as before

  
  
Posted 6 days ago

Hi @<1751777178984386560:profile|ConfusedGoat3> , is the data itself still accessible anywhere in it's entirety?

  
  
Posted 7 days ago
37 Views
4 Answers
7 days ago
5 days ago
Tags