Unanswered
A Question On Pipeline Artifacts And Their Use In Steps. I Want To Add An Artifact To The Pipeline (See Below), And Use It As Input To A Function Step. But The Following Does Not Work Because
Hi @<1523701070390366208:profile|CostlyOstrich36> , here's a more full example of what I would like to be able to do:
some_object_instance = dict(a=1, b=2)
def step_func(some_object):
print(some_object)
pipe = PipelineController(name="my_pipeline", project="my_project")
pipe.upload_artifact(name="some_object", artifact_object=some_object_instance)
pipe.add_function_step(
name="step",
function=step_func,
function_kwargs=dict(param="${pipeline.some_object}"),
)
pipe.start_locally(run_pipeline_steps_locally=True)
And the error is:
"/home/xxx/site-packages/clearml/automation/controller.py", line 2177, in _add_function_step
self.__verify_step_reference(node=self.Node(name=name), step_ref_string=v)
File "/home/xxx/site-packages/clearml/automation/controller.py", line 3116, in __verify_step_reference
raise ValueError("Node '{}', parameter '{}', step name '{}' is invalid".format(node.name, v, prev_step))
ValueError: Node 'step', parameter '${pipeline.some_object}', step name 'pipeline' is invalid
104 Views
0
Answers
9 months ago
9 months ago