Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello Again, Is There Any Way To Get A List Of The Datasets From Clearml That Excludes Archived Datasets?

Hello again,

Is there any way to get a list of the datasets from ClearML that excludes archived datasets?

  
  
Posted 11 months ago
Votes Newest

Answers 17


I'm aware of that but it doesn't help this situation.

  
  
Posted 11 months ago

ok

  
  
Posted 11 months ago

Have a look into that, if it helps.

  
  
Posted 11 months ago

@<1539780284646428672:profile|PoisedElephant79> Sorry for not getting back with this sooner. Dataset.get() doesn't work like you suggested. In the documentation it's clear:

Get a

specific

Dataset. If multiple datasets are found, the dataset with the highest semantic version is returned. If no semantic version is found, the most recently updated dataset is returned. This functions raises an Exception in case no dataset can be found and the

auto_create=True

flag is not set

I tested it and it does return a Dataset object but it's only of one dataset. I don't think it would make sense to return several datasets when you examine the other methods.

  
  
Posted 11 months ago

@<1545216070686609408:profile|EnthusiasticCow4> you can add some tags in the dataset in previous steps and can reuse it later.

  
  
Posted 11 months ago

None

  
  
Posted 11 months ago

You can check it out for deep details.

  
  
Posted 11 months ago

I had 2 datasets on archive and 0 unarchived. When I ran the following command:

Dataset.list_datasets(dataset_project=self.task.get_project_name(), only_completed=True)

It returned two entrees for the two datasets I had on archive.

  
  
Posted 11 months ago

yes

  
  
Posted 11 months ago

@<1539780284646428672:profile|PoisedElephant79> Are you sure you're not simply referring to the get operation? That seems to exclude archived datasets. But I don't see anything like that for the list_datasets operation.

  
  
Posted 11 months ago

Will this return a list of datasets?

  
  
Posted 11 months ago

you can use this...

  
  
Posted 11 months ago

Hey @<1545216070686609408:profile|EnthusiasticCow4> It don't selects the archived dataset by default.

  
  
Posted 11 months ago

Yes I think

  
  
Posted 11 months ago

or can have a look in that file, you will get clear picture of it.

  
  
Posted 11 months ago

Dataset.get

  
  
Posted 11 months ago

you can try it out.

  
  
Posted 11 months ago
707 Views
17 Answers
11 months ago
11 months ago
Tags