Hi DangerousDragonfly8 ! At the moment, this is not possible, but we do have it in plan (we had some prior requests for this feature)
Thank you for the reply SmugDolphin23
Is there any possible workaround at the moment?
DangerousDragonfly8 I'm pretty sure you can use pre_execute_callback
or post_execute_callback
for this. you get the PipelineController
in the callback and the Node
. Then you can modify the next step/node. Note that you might need to access the Task
object directly to change the execution_queue
and docker_args
. You can get it from node.job.task
https://clear.ml/docs/latest/docs/references/sdk/automation_controller_pipelinecontroller#add_function_step
Thank you SmugDolphin23 I'll try it out.
Hi SmugDolphin23 . I have tried to access node.job with a pre_execute_callback but the node object does not have the job attribute set as you can see above.