Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
I Want To Use The Pipelinecontroller Which Assumes A Task Already Been Executed And As Ready As Template. I Never Executed The Task Before And It Is A Very Long Running Task. Is There A Way To Create The Template Without Executing All The Way Through?

I want to use the PipelineController which assumes a task already been executed and as ready as template. I never executed the task before and it is a very long running task. Is there a way to create the template without executing all the way through?

  
  
Posted 2 years ago
Votes Newest

Answers 24


WackyRabbit7 you can also use task.execute_remotely() once the task is configure, like in https://github.com/allegroai/clearml/blob/master/examples/pipeline/step1_dataset_artifact.py#L6 example

  
  
Posted 2 years ago

WackyRabbit7
as TrickySheep9 mentioned, you can use clearml-task . It will create a draft of a task if you do not provide a --queue for it

  
  
Posted 2 years ago

There’s also the cli to create tasks- https://github.com/allegroai/clearml/blob/master/docs/clearml-task.md

  
  
Posted 2 years ago

I only want to save it as a template so I can later call it in a pipeline

  
  
Posted 2 years ago

Wait but I don't want to execute it

  
  
Posted 2 years ago

can you provide an example?

  
  
Posted 2 years ago

Something like this
clearml-task --project YOUR_PROJECT --name SCRIPT_NAME --script PATH/TO/YOUR/SCRIPT --repo YOUR_REPO

  
  
Posted 2 years ago

Nope, quite some time has passed since 🙂 I might be able to replicate it later... still battling with the pipeline to make it work

  
  
Posted 2 years ago

when I specify --packages I shoudl manually list them all not?

  
  
Posted 2 years ago

I don't know, I'm the one asking the question 😄

  
  
Posted 2 years ago

PanickyFish98

  
  
Posted 2 years ago

` ClearML launch - launch any codebase on remote machine running clearml-agent
Creating new task

Error: requirements.txt not found [/home/elior/Dev/Projects/XXXXX/requirements.txt] Use --requirements or --packages `

  
  
Posted 2 years ago

Since they won't be used, I guess you can just specify one package

  
  
Posted 2 years ago

Task.create right?

  
  
Posted 2 years ago

WackyRabbit7 who exactly looked for the requirements.txt?

  
  
Posted 2 years ago

Can you attach the command line and result?

  
  
Posted 2 years ago

and I'll open an issue

  
  
Posted 2 years ago

When I ran the clearml-task --name ... -project ... -script .... it failed saying not requiremetns was found

  
  
Posted 2 years ago

I only want to save it as a template so I can later call it in a pipeline

running with task.execute_remotely() it wont really run the task. it will start it and abort it, so you will have it Aborted , and this is your template task

  
  
Posted 2 years ago

WackyRabbit7 so you basically have two options - by code (as TimelyPenguin76 suggested, not long-running, but quickly-terminating 🙂 ), or using clearml-task

  
  
Posted 2 years ago

I couldn't do it with clearml task as it was looking for a requirements file and I'm workgin with poetry

  
  
Posted 2 years ago

you know what let me try in a sec

  
  
Posted 2 years ago

Yeah, I see what you mean - we'll need to fix it - can you open an GitHub issue? As a workaround, assuming you're using Poetry, you can specify --packages and poetry will ignore them...

  
  
Posted 2 years ago
554 Views
24 Answers
2 years ago
one year ago
Tags