Unanswered
Hey, Im Trying To Create Pipeline Step With A
example pipeline
` from typing import List
from clearml import PipelineDecorator
@PipelineDecorator.component(
execution_queue="default",
docker="python:3.7",
packages=["clearml"]
)
def download(files: List[str]):
if isinstance(files, str):
print("its a str")
for f in files:
print(f"download file: {f}")
@PipelineDecorator.pipeline(
name='something',
project='batch data processing',
version='0.1'
)
def batch_pipeline():
return download(
[
"file1.txt",
"file2.txt",
]
)
if name == 'main':
PipelineDecorator.run_locally()
batch_pipeline() `
163 Views
0
Answers
2 years ago
one year ago