Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello Again, Is There Any Way To Get A List Of The Datasets From Clearml That Excludes Archived Datasets?

Hello again,

Is there any way to get a list of the datasets from ClearML that excludes archived datasets?

  
  
Posted one year ago
Votes Newest

Answers 17


I had 2 datasets on archive and 0 unarchived. When I ran the following command:

Dataset.list_datasets(dataset_project=self.task.get_project_name(), only_completed=True)

It returned two entrees for the two datasets I had on archive.

  
  
Posted one year ago

you can use this...

  
  
Posted one year ago

yes

  
  
Posted one year ago

ok

  
  
Posted one year ago

@<1545216070686609408:profile|EnthusiasticCow4> you can add some tags in the dataset in previous steps and can reuse it later.

  
  
Posted one year ago

or can have a look in that file, you will get clear picture of it.

  
  
Posted one year ago

I'm aware of that but it doesn't help this situation.

  
  
Posted one year ago

@<1539780284646428672:profile|PoisedElephant79> Are you sure you're not simply referring to the get operation? That seems to exclude archived datasets. But I don't see anything like that for the list_datasets operation.

  
  
Posted one year ago

Hey @<1545216070686609408:profile|EnthusiasticCow4> It don't selects the archived dataset by default.

  
  
Posted one year ago

Yes I think

  
  
Posted one year ago

Will this return a list of datasets?

  
  
Posted one year ago

@<1539780284646428672:profile|PoisedElephant79> Sorry for not getting back with this sooner. Dataset.get() doesn't work like you suggested. In the documentation it's clear:

Get a

specific

Dataset. If multiple datasets are found, the dataset with the highest semantic version is returned. If no semantic version is found, the most recently updated dataset is returned. This functions raises an Exception in case no dataset can be found and the

auto_create=True

flag is not set

I tested it and it does return a Dataset object but it's only of one dataset. I don't think it would make sense to return several datasets when you examine the other methods.

  
  
Posted one year ago

Have a look into that, if it helps.

  
  
Posted one year ago

Dataset.get

  
  
Posted one year ago

None

  
  
Posted one year ago

you can try it out.

  
  
Posted one year ago

You can check it out for deep details.

  
  
Posted one year ago
1K Views
17 Answers
one year ago
one year ago
Tags