Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, I Am Using Datasets In Community Server. I Have Been Trying To Create A Child Dataset The Following Way: Dataset_Name = "Training2501" Dataset_Project = "Datasets" Dataset_Path = Dataset.Create( Dataset_Name=Dataset_Name, Dataset_Project=Da

Hello, I am using Datasets in Community server. I have been trying to create a child dataset the following way: dataset_name = "Training2501"
dataset_project = "datasets"
dataset_path = Dataset.create(
dataset_name=dataset_name,
dataset_project=dataset_project,
parent_datasets = 'a75f70a.......' ) ## the task id taken from clearml ID

and recieve the following error:
clearml.Task - ERROR - Action failed <400/101: tasks.get_by_id/v1.0 (Invalid task id: id=a, company=31ecf1838778471f91e3dd91b45d80cd)> (task=a)
)

  
  
Posted 2 years ago
Votes Newest

Answers 9


Is there anything special about the parent dataset?

  
  
Posted 2 years ago

it is finalised

  
  
Posted 2 years ago

In the child dataset task I see the following :
ARTIFACTS - > STATE:
Dataset state
Files added/modified: 1 - total size 518.78 MB
Current dependency graph: {
"0385db....": [], ()
"94f4....": ["0385db..."]
}
child task is 94f4.. and parent task is "0385db..." but what does the (
) line means?

  
  
Posted 2 years ago

That would explain why it reports the task id to be 'a' in the error. It tried to index the first element in a list, but took the first character of a string instead.

  
  
Posted 2 years ago

The SDK treats it as an itrable, and so the first element (since a string is an iterable of chars) is 'a'...

  
  
Posted 2 years ago

Thanks!!

  
  
Posted 2 years ago

AbruptWorm50 I think your issue is that the parents should be a list of strings, not a sting

  
  
Posted 2 years ago

I think that would defeat the purpose of lineage no? The point is to keep track of where data came from in the real world. Rewriting that record is just kind of... metadata?
As for the (*) line, could it be that "0385db..." itself does not have parents itself? So "0385db..." is the base dataset, without parents, and it has 1 child, which has "0385db..." as its parent

  
  
Posted 2 years ago

Another question: Is there a way to group together Dataset tasks (i.e redefine their parent) after the tasks have been finalized? In the same context: is there a way to change the dependency graph in the clearml dashboard after the task creation and finalization ?

  
  
Posted 2 years ago
675 Views
9 Answers
2 years ago
one year ago
Tags