Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Am Using Clearml Free Saas. I Have A Task "Mytask" Of Type "Data_Processing" In Project "Myproject" Which Uploads A Dataset In The End Of Its Execution. For Some Reason, After Uploading The Dataset, My Task Appears In Ui Not Under "Myproject", But Under

I am using clearml free saas. I have a task "MyTask" of type "data_processing" in project "MyProject" which uploads a dataset in the end of its execution. For some reason, after uploading the dataset, my task appears in UI not under "MyProject", but under "MyProject/.datasets/MyTask". Can I change this?

  
  
Posted 7 months ago
Votes Newest

Answers 13


from clearml import Task, Dataset

task = Task.init(
    project_name="MyProject",
    task_name="MyTask",
    task_type=Task.TaskTypes.data_processing,
    reuse_last_task_id=False,
    output_uri="
"
)

with open("new_file.txt", "w") as file:
    file.write("Hello, world!")

dataset = Dataset.create(parent_datasets=None, use_current_task=True)
dataset.add_files(".", wildcard="new_file.txt", verbose=True)
dataset.upload(verbose=True)
dataset.finalize(verbose=True)
  
  
Posted 7 months ago

image

  
  
Posted 7 months ago

I did similarly at my previous work (we had open source clearml deployed). The problem I described here was not present there. I liked this approach. It was convenient that dataset_id and task_id are the same.

  
  
Posted 6 months ago

So you'd recommend setting use_current_task=False when creating the dataset in this task or should this be done somehow differently?

  
  
Posted 6 months ago

it was a year ago, so yeah.

  
  
Posted 6 months ago

Hi @<1613344994104446976:profile|FancyOtter74> , I think this is cause because you're creating a dataset in the same task. Therefor there is a connection between the task and the dataset and they are moved to a special folder for datasets. Is there a specific reason why you're creating both a Task & Dataset in the same code?

  
  
Posted 6 months ago

Tried it on 1.13.1. Same problem. @<1523701087100473344:profile|SuccessfulKoala55> any advice?

  
  
Posted 6 months ago

clearml==1.12.2

  
  
Posted 7 months ago

I think that should work

  
  
Posted 5 months ago

Any updates? Should I provide any extra context?

  
  
Posted 6 months ago

Is it possible you used an older clearml version there where this was allowed?

  
  
Posted 6 months ago

Hi @<1613344994104446976:profile|FancyOtter74> , can you share the code that does that?

  
  
Posted 7 months ago

result: None

  
  
Posted 7 months ago
446 Views
13 Answers
7 months ago
5 months ago
Tags