Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey

Hey 🙂
Working with ClearML pipelines, is there a way to change default directory artifacts to archive with tar instead of zip ?

Speaking of the default return objects in steps (Which we don’t log explicitly)

  
  
Posted 2 years ago
Votes Newest

Answers 6


I know zip and tar.gz are supported for auto extraction. But you're looking for a setting to have artifacts compressed with tar instead of zip?

  
  
Posted 2 years ago

For pipelines there's currently no way to use different compressions. You can still use it when explicitly uploading https://clear.ml/docs/latest/docs/references/sdk/dataset/#upload

  
  
Posted 2 years ago

Ok, tnx (:
We just see that taring and untaring is much faster than zip for big models

  
  
Posted 2 years ago

you can pass use the compression parameter in dataset.upload . The supported values are:
ZipFile.ZIP_STORED (no compression) ZipFile.ZIP_DEFLATED (requires zlib) ZipFile.ZIP_BZIP2 (requires bz2) ZipFile.ZIP_LZMA (requires lzma)Note that you need to import ZipFile beforehand: from zipfile import ZipFile
You're probably looking for ZIP_BZIP2 , but I'm not sure about that.

  
  
Posted 2 years ago

It's models not datasets in our case...

But we can also just tar the folder and return that... Was just hoping to avoid doing that

  
  
Posted 2 years ago

PricklyRaven28 I think then you're looking for: ZipFile.ZIP_STORED

  
  
Posted 2 years ago
985 Views
6 Answers
2 years ago
one year ago
Tags