Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Quick Question About Clearml-Data: It Seems Like It Is Only Using A Single Thread For Compression. Is There A Way To Use Multi-Threading? For Big Datasets It Takes Quite A While To Upload.

Hi quick question about clearml-data: It seems like it is only using a single thread for compression. Is there a way to use multi-threading? For big datasets it takes quite a while to upload.

  
  
Posted 2 months ago
Votes Newest

Answers 3


Hi @<1523701070390366208:profile|CostlyOstrich36>
Thanks a lot. It seems there is no such option in clearml-data CLI, right?

  
  
Posted 2 months ago

Also, is max_workers about compression threads or upload threads or both?

  
  
Posted 2 months ago

Hi @<1523701868901961728:profile|ReassuredTiger98> , how are you currently uploading? You can use the max_workers parameter to use multiple threads

  
  
Posted 2 months ago