Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello Again, Is There Any Way To Get A List Of The Datasets From Clearml That Excludes Archived Datasets?

Hello again,

Is there any way to get a list of the datasets from ClearML that excludes archived datasets?

  
  
Posted 5 months ago
Votes Newest

Answers 17


you can try it out.

  
  
Posted 5 months ago

you can use this...

  
  
Posted 5 months ago

yes

  
  
Posted 5 months ago

@<1539780284646428672:profile|PoisedElephant79> Sorry for not getting back with this sooner. Dataset.get() doesn't work like you suggested. In the documentation it's clear:

Get a

specific

Dataset. If multiple datasets are found, the dataset with the highest semantic version is returned. If no semantic version is found, the most recently updated dataset is returned. This functions raises an Exception in case no dataset can be found and the

auto_create=True

flag is not set

I tested it and it does return a Dataset object but it's only of one dataset. I don't think it would make sense to return several datasets when you examine the other methods.

  
  
Posted 5 months ago

Hey @<1545216070686609408:profile|EnthusiasticCow4> It don't selects the archived dataset by default.

  
  
Posted 5 months ago

Will this return a list of datasets?

  
  
Posted 5 months ago

ok

  
  
Posted 5 months ago

@<1539780284646428672:profile|PoisedElephant79> Are you sure you're not simply referring to the get operation? That seems to exclude archived datasets. But I don't see anything like that for the list_datasets operation.

  
  
Posted 5 months ago

None

  
  
Posted 5 months ago

You can check it out for deep details.

  
  
Posted 5 months ago

Yes I think

  
  
Posted 5 months ago

I'm aware of that but it doesn't help this situation.

  
  
Posted 5 months ago

Have a look into that, if it helps.

  
  
Posted 5 months ago

I had 2 datasets on archive and 0 unarchived. When I ran the following command:

Dataset.list_datasets(dataset_project=self.task.get_project_name(), only_completed=True)

It returned two entrees for the two datasets I had on archive.

  
  
Posted 5 months ago

@<1545216070686609408:profile|EnthusiasticCow4> you can add some tags in the dataset in previous steps and can reuse it later.

  
  
Posted 5 months ago

or can have a look in that file, you will get clear picture of it.

  
  
Posted 5 months ago

Dataset.get

  
  
Posted 5 months ago
390 Views
17 Answers
5 months ago
5 months ago
Tags