Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey

Hey 🙂
Working with ClearML pipelines, is there a way to change default directory artifacts to archive with tar instead of zip ?

Speaking of the default return objects in steps (Which we don’t log explicitly)

  
  
Posted one year ago
Votes Newest

Answers 6


you can pass use the compression parameter in dataset.upload . The supported values are:
ZipFile.ZIP_STORED (no compression) ZipFile.ZIP_DEFLATED (requires zlib) ZipFile.ZIP_BZIP2 (requires bz2) ZipFile.ZIP_LZMA (requires lzma)Note that you need to import ZipFile beforehand: from zipfile import ZipFile
You're probably looking for ZIP_BZIP2 , but I'm not sure about that.

  
  
Posted one year ago

For pipelines there's currently no way to use different compressions. You can still use it when explicitly uploading https://clear.ml/docs/latest/docs/references/sdk/dataset/#upload

  
  
Posted one year ago

It's models not datasets in our case...

But we can also just tar the folder and return that... Was just hoping to avoid doing that

  
  
Posted one year ago

PricklyRaven28 I think then you're looking for: ZipFile.ZIP_STORED

  
  
Posted one year ago

Ok, tnx (:
We just see that taring and untaring is much faster than zip for big models

  
  
Posted one year ago

I know zip and tar.gz are supported for auto extraction. But you're looking for a setting to have artifacts compressed with tar instead of zip?

  
  
Posted one year ago
977 Views
6 Answers
one year ago
one year ago
Tags