Regarding the agent - No particular reason. Can you point me on how to do it?
This is a good place to start
https://clear.ml/docs/latest/docs/getting_started/mlops/mlops_first_steps
We need the automagic...
This is one of the great benefits of using clearml
😄
Sure, try this one:Task.debug_simulate_remote_task('reused_task_id') task = Task.init(...)Notice it will take the arguments form the cleaml-task itself (e.g. override argparse arguments with what you have on the reused Task). Would that help?
Then it initiate a run on aws, which I want it to use the same task-id.
BoredPigeon26 Clone the Task, it basically creates a new copy (of the setup/configuration etc.)/
Then you can launch it on an aws instance (I'm assuming with clearml-agent)
wdyt?
But it write-over the execution tab in the gui
It does you are correct, it will however Not overwrite the reports (log scalars etc)
AgitatedDove14 Regarding the agent - No particular reason. Can you point me on how to do it?
Is there a way to connect to the task without initiating a new one without overriding the execution?
You can, but not with automagic, you can manually send metrics/logs...
Does that help? or do we need the automagic?
We need the automagic... 🙂
This is one of the great benefits of using clearml 🙂
Thanks for the quick reply,
I have a task I run, that have access to the git repo.
Then it initiate a run on aws, which I want it to use the same task-id.
I tried:reuse_last_task_id=a_task_id_stringBut it write-over the execution tab in the gui
AgitatedDove14 Thanks again.
I'm not using a clearml-agent as far as I know (I just run task.init(...) on the AWS machine.
Is there a way to connect to the task without initiating a new one without overriding the execution?
Hi BoredPigeon26
what do you mean by "reuse the task" ? is this manual execution (i.e. from code)?
How about archiving the old version?
You can also force Task.init to always create a new Task (which preserves the previous run alongside the execution tab)
Basically what's the specific use case ?