Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, Currently Running

Hi, currently running Dataset.list_datasets() on a giant list of datasets takes a very long time to return the full datasets list. Similarly running Dataset.get() also takes a fairly long time to run and retrieve a single dataset object. Does anyone know if there is a way to retrieve a whole list of datasets and getting a single dataset faster?

  
  
Posted 11 months ago
Votes Newest

Answers 4


So you're using the community server? Response time really depends on the resources of the machine that is running the server and amount of data to filter

  
  
Posted 11 months ago

currently not, but the aim is to host it locally. Would that make retrieval much faster?

  
  
Posted 11 months ago

Hi @<1747428509627715584:profile|CumbersomeDuck6> , are you using a self hosted server?

  
  
Posted 11 months ago

Hm I see. Because I am wondering how come when I view clearml datasets in the clearml GUI, it can just show all my data almost instantly, but when using ClearML SDK, it is so slow?

  
  
Posted 11 months ago
593 Views
4 Answers
11 months ago
11 months ago
Tags