I don't know, I'm the one asking the question 😄
WackyRabbit7 so you basically have two options - by code (as TimelyPenguin76 suggested, not long-running, but quickly-terminating 🙂 ), or using clearml-task
I only want to save it as a template so I can later call it in a pipeline
There’s also the cli to create tasks- https://github.com/allegroai/clearml/blob/master/docs/clearml-task.md
Something like thisclearml-task --project YOUR_PROJECT --name SCRIPT_NAME --script PATH/TO/YOUR/SCRIPT --repo YOUR_REPO
` ClearML launch - launch any codebase on remote machine running clearml-agent
Creating new task
Error: requirements.txt not found [/home/elior/Dev/Projects/XXXXX/requirements.txt] Use --requirements or --packages `
when I specify --packages
I shoudl manually list them all not?
Can you attach the command line and result?
When I ran the clearml-task --name ... -project ... -script ....
it failed saying not requiremetns was found
WackyRabbit7 who exactly looked for the requirements.txt?
Since they won't be used, I guess you can just specify one package
I couldn't do it with clearml task as it was looking for a requirements file and I'm workgin with poetry
WackyRabbit7 you can also use task.execute_remotely()
once the task is configure, like in https://github.com/allegroai/clearml/blob/master/examples/pipeline/step1_dataset_artifact.py#L6 example
Nope, quite some time has passed since 🙂 I might be able to replicate it later... still battling with the pipeline to make it work
I only want to save it as a template so I can later call it in a pipeline
running with task.execute_remotely()
it wont really run the task. it will start it and abort it, so you will have it Aborted
, and this is your template task
WackyRabbit7
as TrickySheep9 mentioned, you can use clearml-task
. It will create a draft of a task if you do not provide a --queue
for it
Yeah, I see what you mean - we'll need to fix it - can you open an GitHub issue? As a workaround, assuming you're using Poetry, you can specify --packages
and poetry will ignore them...