Unanswered
Is There An External Way To Access Pipelinecontroller._Relaunch_Node(Node) ?
this is a protected property and therefore should not be called from outside (meaning it's not good practice to do my_pipeline_controller._relaunch_node(failed_node)
I want to create a status_change_callback that checks if node failed due to connection loss, and if so re-adds the task to the queue
my current code looks like this:
def retry_on_connection_error(pipeline: PipelineController, node: PipelineController.Node, *_, **__) -> None:
if not (node.job is None):
is_stopped = node.job.is_stopped(aborted_nonresponsive_as_running=True)
if is_stopped:
is_connection_lost = node.job.is_stopped(aborted_nonresponsive_as_running=False)
if is_connection_lost:
LOGGER.warning(f"Node {node.name} lost connection with worker {node.job.worker,name}")
pipeline._relaunch_node(node)
else:
LOGGER.info(f"Node {node.name} is stopped")
85 Views
0
Answers
8 months ago
8 months ago