Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Currently Running

Hi, currently running Dataset.list_datasets() on a giant list of datasets takes a very long time to return the full datasets list. Similarly running Dataset.get() also takes a fairly long time to run and retrieve a single dataset object. Does anyone know if there is a way to retrieve a whole list of datasets and getting a single dataset faster?

  
  
Posted 2 months ago
pic
More
CumbersomeDuck6
0 × 1
Report
Votes Newest

Answers 4

Hm I see. Because I am wondering how come when I view clearml datasets in the clearml GUI, it can just show all my data almost instantly, but when using ClearML SDK, it is so slow?

  
  
Posted 2 months ago
pic
More
CumbersomeDuck6
0 × 1
Report

So you're using the community server? Response time really depends on the resources of the machine that is running the server and amount of data to filter

  
  
Posted 2 months ago
pic
More
CostlyOstrich36
0
Report

Hi @<1747428509627715584:profile|CumbersomeDuck6> , are you using a self hosted server?

  
  
Posted 2 months ago
pic
More
CostlyOstrich36
0
Report

currently not, but the aim is to host it locally. Would that make retrieval much faster?

  
  
Posted 2 months ago
pic
More
CumbersomeDuck6
0 × 1
Report
Write your answer
83 Views
4 Answers
2 months ago
2 months ago
Tags
clearml