Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Am Training With A Significant Amount Of Images. I Have Created A Clearml Dataset Containing Two Folders: Images And Labels. Until Now I Have Created A Local-Copy (Dataset.Get_Local_Copy()), And Worked With The Data In ‘Data_Set’ Path. I Now Want (A

Hi,
I am training with a significant amount of images. I have created a clearml Dataset containing two folders: images and labels. Until now I have created a local-copy (dataset.get_local_copy()), and worked with the data in ‘data_set’ path. I now want (a) to migrate to clearml agents, and (b) not load the entire dataset before training.
How can I sequentially load parts of the dataset? dataset.get_num_chunks(include_parents=True) return 0 …
Thank you!

  
  
Posted one year ago
Votes Newest

Answers 2


Hi @<1695969549783928832:profile|ObedientTurkey46> , this capability is only covered in the Hyperdatasets feature. There you can both chunk and query specific metadata.
None

  
  
Posted one year ago

That sounds interesting. Will this also work in a on-prem hosting environment?

  
  
Posted one year ago
1K Views
2 Answers
one year ago
one year ago
Tags