Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I Created A Pipeline From One Block, Passed The Initial Parameters. Please Tell Me, Is It Possible To Make A New Launch Of The Pipeline, But With Different Parameters, Just Like In The Draft Mode Of Usual Experiments. Globally, I Want To Init

Hi everyone! I created a pipeline from one block, passed the initial parameters. Please tell me, is it possible to make a new launch of the pipeline, but with different parameters, just like in the draft mode of usual experiments. Globally, I want to initialize the pipeline once and then launch the pipeline from web UI, but with different parameters

My task and pipeline form task in screenshot and below

from clearml.automation import PipelineController


pipe = PipelineController(
    name="Creating labelsudio task", project="examples", version="0.0.1", add_pipeline_tags=False
)

pipe.set_default_execution_queue("default")


pipe.add_parameter(
    name="title_project",
    default="Creating from api test",
    description="New name of project",
)

pipe.add_parameter(
    name="description_project",
    default="Project for ocr markup",
    description="Project Description",
)

pipe.add_parameter(
    name="template",
    default="ocr.xml",
    description="Template type for annotation",
)

pipe.add_parameter(
    name="auth_token",
    default="123123123123123123123123123",
    description="Auth token for labelstudio",
)

pipe.add_parameter(
    name="bucket",
    default="my_bucket",
    description="S3 bucket",
)

pipe.add_parameter(
    name="prefix",
    default="test_folder/",
    description="Path data from bucket",
)

pipe.add_step(
    name="stage_data",
    base_task_id='feb20dd5f79049d48e3bf4f94651b542',

    parameter_override={
        'General/title_project': "${pipeline.title_project}",
        'General/description_project': "${pipeline.description_project}",

        'General/template': "${pipeline.template}",
        'General/auth_token': "${pipeline.auth_token}",

        'General/bucket': "${pipeline.bucket}",
        'General/prefix': "${pipeline.prefix}",
    }
)

pipe.start(queue='default')

print("done")

image
image

  
  
Posted one year ago
Votes Newest

Answers 13


Hi @<1524560082761682944:profile|MammothParrot39> , I think you need to run the pipeline at least once (at least the first step should start) for it to "catch" the configs. I suggest you run once with pipe.start_locally(run_pipeline_steps_locally=True)

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36> A simple run with the options I changed in the second run

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36>
image

  
  
Posted one year ago

image

  
  
Posted one year ago

after running I already can't set new params
image

  
  
Posted one year ago

when I start a new run I can't change initial parametrs
image

  
  
Posted one year ago

That's strange indeed. What if you right click one of the pipeline executions and click on run?

  
  
Posted one year ago

Did the second run, run remotely or locally?

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36>
It's strange, during the first remote start I could set the options. But now I can't again. With what it can be connected?
image

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36> Second run was remotely

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36>
Yes, it's work)
Thank you so much

  
  
Posted one year ago

@<1523701070390366208:profile|CostlyOstrich36> While pipeline in pending process, i can set new run, but after compliting not
image

  
  
Posted one year ago
871 Views
13 Answers
one year ago
one year ago
Tags