Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi There! Is There Any Way To Boost Creating Sha2 Hashes During

Hi there! Is there any way to boost creating SHA2 hashes during clearml-data add ? It uses only one CPU core, could I use multiprocessing somehow?

  
  
Posted 2 years ago
pic
More
EcstaticMouse10
0 × 1
Report
Votes Newest

Answers 3

It uses only one CPU core, could I use multiprocessing somehow?

Hi EcstaticMouse10
Hmm, yes it should be multi core:
https://github.com/allegroai/clearml/blob/a9774c3842ea526d222044092172980ae505e24f/clearml/datasets/dataset.py#L1175
wdyt?

  
  
Posted 2 years ago
pic
More
AgitatedDove14
0 × 1
Report

I don't know, why it uses only 1 core.

  
  
Posted 2 years ago
pic
More
EcstaticMouse10
0 × 1
Report

Switching to process Pool might be a bit of an overkill here (I think)
wdyt?

  
  
Posted 2 years ago
pic
More
AgitatedDove14
0 × 1
Report
Write your answer
1K Views
3 Answers
2 years ago
one year ago
Tags
dataset