Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Am Quite New To Clearml And Can Someone Please Tell Me How To Use A Dataset That Have Been Uploaded To The Clearml Data Directly To A Experiment. As A Csv File Or Directly The Type Of The Data?

Hi, I am quite new to clearml and Can someone please tell me how to use a dataset that have been uploaded to the clearml data directly to a experiment. As a csv file or directly the type of the data?

  
  
Posted one year ago
Votes Newest

Answers 5


Hi GrittyHawk31 , you can use Dataset.get(). If you're using a file you can call Dataset.get_local_copy() to download it.
You can check https://clear.ml/docs/latest/docs/clearml_data/data_management_examples/data_man_python#data-ingestion documentation out or an https://github.com/allegroai/clearml/blob/master/examples/datasets/data_ingestion.py that uses it

  
  
Posted one year ago

Hi,
You may want to consider to do the visualizing while creating the Datasets - see https://github.com/thepycoder/asteroid_example/blob/main/get_data.py#L34 logging the head() of the dataframe

  
  
Posted one year ago

Hi, AnxiousSeal95 suppose we have uploaded a csv file, and want to get the csv file to do some pre processing tasks, then is there a way to get that csv file to that script to do further tasks on the dataset like we normally do?

  
  
Posted one year ago

What is the format of data we get from using dataset.get() AnxiousSeal95 , I just wanted to visualize the columns of that csv file and plot some details. Can I do that directly from the output from Dataset.get() ?

  
  
Posted one year ago

Hi GrittyHawk31 , maybe I'm missing something, but what stops you from using Dataset.get() in the preprocessing script? Is there a limitation on it?

  
  
Posted one year ago