Hi. Is it possible to run pipelines clearml using yaml manifests like kubeflow style?
2 years ago
Yes. I Mean this. Like You have YAML Manifest and command like in yaml: python -m clearml_pipeline/
` @PipelineDecorator.component(return_values=['data_frame'], cache=True, task_type=TaskTypes.data_processing)
def step_one(pickle_data_url: str, extra: int = 43):
print('step_one')
# make sure we have scikit-learn for this step, we need it to use to unpickle the object
import sklearn # noqa
import pickle
import pandas as pd
from clearml import StorageManager
local_i...